Let's start with the fact that we have no idea what 97% of the universe is made of. It's easy to forget that. I don't remember the exact numbers but I think roughly 2/3 is dark energy and 1/3 is dark matter with the rounding error being the matter and energy that we actually know something about.
So we have no idea whatsoever about what's possible in terms of traveling across space. Quantum mechanics is non-local so in theory, something on one side of the universe can affect something on the other side instantaneously - what Einstein called spooky action at a distance. And again, remember, QM only describes that 3% of the universe we know something about.
So . . . either the other 97% of the universe holds no interesting mysteries to solve and will give us no new technological abilities we can exploit like negative energy to build an Alcubierrie warp drive or something even more advanced, or it does and maybe hopping between stars and galaxies is no more difficult than a trip to the store.
In which case, if intelligent life is common in the universe, then there's no reasonable explanation for why we haven't found it. Or rather, why it hasn't found us. The standard Star Trek, prime directive argument is bs. That's a rank anthropomorphizing of alien life. They wouldn't be anything like us and certainly wouldn't have the same cultural values. At least some of those civilizations would have no problem knocking on our door either to say hi or to kill us.
So either advanced sentient life doesn't exist at all or it's extremely rare. Either that or the laws of the universe, the vast majority of which we don't even know of yet, prohibit faster than light travel.
The only other explanation I can think of is that because of the incalculable number of world in the universe and the terminally slow speed of light relative to its size, it's only been about a billion years or so since the earth has looked interesting enough to visit from an alien perspective. That means that light from our planet has only reached a fraction of the rest of the universe. So if advanced civilizations are relatively rare, they may not yet be aware of us.