I dont see why the predictive frames cant use your input, especially for simple things like camera translation or rotation
It would be jarring in an FPS if the frame rate dropped by 75% every instant you pulled the trigger, but i am very curious to see how it handles sudden screen changes like muzzle flash, or opening a door, or scrolling text or a million other things
It's not predictive. These are still in between frames. It's
holding back a real frame, inject 3 fake ones, and
then showing the real one, that it was holding back.
Nothing can change those three fake frames, because they are in the past, and it already has a real frame after them used to generate the steps in between. You can only influence the future after the held back real frame drops.
Example:
Roll a ball across floor.
No FG:
Real frame 1, ball 2 feet away,
Real frame 2, ball 8 feet away,
RTX 40 FG:
Real frame 1, ball 2 feet away,
Fake frame 1, figure out ball is 5 feet away, by interpolating between real frames.
Real frame 2, ball 8 feet away (this frame was held back and used to generate fake frame 1)
RTX 40 FG:
Real frame 1, ball 2 feet away,
Fake frame 1, figure out ball is 3.5 feet away by interpolating more steps between real frames.
Fake frame 2, figure out ball is 5 feet away by interpolating more steps between real frames.
Fake frame 3, figure out ball is 6.5 feet away by interpolating more steps between real frames.
Real frame 2, ball 8 feet away (this frame was held back and used to generate fake frame 1,2,3)