That's true and why it will probably never work.
However,
There is one small lead:
The EM Drive NASA was playing with
may manipulate the quantum vacuum in a similar way that Casimir plates do:
So as of right now I'd say there is long long odds for this to actually work, but not currently impossible. NASA has put a nickel in the slot machine budget wise to see if it might work.