Performance drop is one effect, but most games pull down the texture quality before they show stutters, if at all. Benchmarking sites that don't play for long, would never notice even the stutters because often the game loads fine for the VRAM available, but slowly consumes more over a period...