Originally posted by: Endgame124
Originally posted by: ShadowOfMyself
Interesting the number of new members posting here
Ive been out of the loop since the 8800GTX launch because nothing exciting has happened yet (shame on you AMD and Nvidia) but I remember reading some dreadful Hocp reviews and discussing in their forums... Wait, did I say discussing? I didnt have time to do any of that because as soon as I expressed my disappointment towards Kyle he banned me :|
He needs to shut his trap, apples to apples benchmarks are where its at... I dont care about his methods, their benchmarks are just unnacceptable... When you wanna compare 2 cars by test driving them, are you gonna use different tracks? I dont think so! Wouldnt make much sense now, would it? It might or might not be the same as "real world experience" but the lack of variables make it a good benchmark either way... Meanwhile, Kyle happily goes through a light area with the card he likes, and then when benchmarking the other card, taxes it as much as he can... Oh but.. Its real world benchmarking :roll:
But has anyone proven that timedemos play relative to actual game performance?
ex: Card A, Timedemo A: 50fps
While actually playing the game will it get 50fps?
Even worse, has anyone proven the following doesn't occur:
Card A, Timedemo A: 50fps
Card A, in game fps: 22fps
Card B, Timedemo A: 45fps
Card B, in game fps: 40fps
If you only run timedemos for Game A, card A will appear to the card to buy. But if you play the game, obviously Card B is the card to get. You may not be able to identically repeast tests while actually in the game, but knowing what you're going to get while playing the game seems like what a reader would want to know.
I'd imagine readers of any review site want to know which card actually plays the best. If the timedemo is relational to real gameplay, then use timedemos (and please provide proof that the timedemo is relational). If the timedemo is not relational, please do in game testing (and provide proof that the timedemo is NOT relational to real game performance).
Sounds pretty simple to me....