On the AMD side, I had a fx-62 clocked to 3.15 ghz. I made the move to quad core and couldn't be happier. I now run a 9850 @ 3.0 ghz and there is no comparison, it is much faster. In games I have smooth frame rates, I play oblivion, bioshock, Heroes 5. Don't have a lot of hard data to throw out there, just feels faster and runs better. 3dmark06 was at just under 11000 with the fx-62. The Quad core gets over 12000 with same 8800gt 512MB.
Also using 1066 ram, so I'm sure that's a factor as well, now I have XP64 and 4 gigs ram as opposed to two. So all of these are factors, but I still think the most significant upgrade was the quad core. As far as xp64 goes, the most significant change (and I was hoping for speed) is that it is rock solid and I don't crash. Most stable OS I have used, except for Linux of course. Occasionally I will have a game lock-up, but that only happens about once a month I'd say.
Right now I don't see a reason not to buy a quad core, unless one wants to save money and oc to the moon. Any of todays quad cores will be plenty fast for the next few years.