Civilization VI: Performance Analysis (Techpowerup)

Page 8 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

Spjut

Senior member
Apr 9, 2011
928
149
106
So only DX12 on Maxwell and Pascal for Nvidia. Was the same deal with Total War Warhammer.
 

bystander36

Diamond Member
Apr 1, 2013
5,154
132
106
40 FPS is not the lowest it got. The 99th percentile is at 33.9 ms, which is equal to 29.5 FPS.
I went off what was shown in the video. And 99th percentile frame length just means there is the occasional long frame. FPS are an average per second.
 
Last edited:

dogen1

Senior member
Oct 14, 2014
739
40
91
This is sad to read. I hope reviews show something better. Considering the game is heavily CPU bottlenecked, you'd expect DX12 to be a godsend.

Yeah, game logic bottlenecked most likely.
DX12 has nothing to do with that..
 

Stormflux

Member
Jul 21, 2010
140
26
91
These were my results just running the benchmark last night. Disappointed in the no UI scale for 1440p still. Will play a proper game this weekend sometime.

DX11 Graphics:
Average Frame Time - 16.627
99th Percentile - 25.482

DX11 AI - 21.80 Average Turn Time


DX12 Graphics:
Average Frame Time - 14.658
99th Percentile - 18.667

DX12 AI - 21.46 Average Turn Time

X5650@ 4ghz
12GB Ram
Fury X


Too bad there isn't a bigger difference in Average Turn Time, looks within a margin of error. It is the thing that makes the game drag on at the end.


And then someone responded with his GTX1080 setup on NeoGAF.

Compare it to my 1080 + 4770k:

DX11:
Average - 13.353
99th Percentile - 18.046

DX12:
Average - 13.192
99th Percentile - 17.332
 

antihelten

Golden Member
Feb 2, 2012
1,764
274
126
I went off what was shown in the video. And 99th percentile frame length just means there is the occasional long frame. FPS are an average per second.

FPS is not necessarily an average per second, only average fps is an average per second, you can also calculate FPS from single frametimes (this is how fps graphs are made).

Either way the reason I mentioned the 99th percentile frame time, was because the discussion was about FPS dips (or inversely frame time spikes), which is what the 99th percentile score is all about.
 

bystander36

Diamond Member
Apr 1, 2013
5,154
132
106
FPS is not necessarily an average per second, only average fps is an average per second, you can also calculate FPS from single frametimes (this is how fps graphs are made).

Either way the reason I mentioned the 99th percentile frame time, was because the discussion was about FPS dips (or inversely frame time spikes), which is what the 99th percentile score is all about.
FPS stands for (f)rames (p)er (s)econd. So yes, it does mean over the course of a second. Anyway, it's not that critical anyway, as it is a turn based game.
 

antihelten

Golden Member
Feb 2, 2012
1,764
274
126
FPS stands for (f)rames (p)er (s)econd. So yes, it does mean over the course of a second. Anyway, it's not that critical anyway, as it is a turn based game.

Yes it means frames per second, but that doesn't necessarily mean that it's an average per second. For instance you can have 3 frames with frame times of 10, 15 and 30 ms. This would be equal to instantaneous FPS values of 100 FPS, 67 FPS and 33 FPS (these are the values that would be plotted in an FPS graph), and an average of 54.5 FPS.
 

bystander36

Diamond Member
Apr 1, 2013
5,154
132
106
Yes it means frames per second, but that doesn't necessarily mean that it's an average per second. For instance you can have 3 frames with frame times of 10, 15 and 30 ms. This would be equal to instantaneous FPS values of 100 FPS, 67 FPS and 33 FPS (these are the values that would be plotted in an FPS graph), and an average of 54.5 FPS.
In terms of the 99th percentile frame times. That doesn't really translate to FPS. It's a measure of how often or noticeable stuttering may be. Trying to convert that to FPS is pretty meaningless.
 

antihelten

Golden Member
Feb 2, 2012
1,764
274
126
In terms of the 99th percentile frame times. That doesn't really translate to FPS. It's a measure of how often or noticeable stuttering may be. Trying to convert that to FPS is pretty meaningless.

Of course it translates to FPS, just the 99th percentile FPS in this case (remember frame times are simply the inverse of FPS).
 

bystander36

Diamond Member
Apr 1, 2013
5,154
132
106
Of course it translates to FPS, just the 99th percentile FPS in this case (remember frame times are simply the inverse of FPS).
You are talking about a single frame within 100. This is not what we get when we measure for minimum FPS. This is what we get when using FCAT or some other frame time software. You are talking about hickups, rather than anything over a period of time. While hickups can be annoying, if they are meaningful, they aren't the same thing as having a few seconds of 30 FPS. Most won't realize it even happened if it's close to the average minimum over a second.

You aren't going to see that single frame time hickup show up on a minimum FPS chart, unless it was a long enough frame to span most of a second.
 

antihelten

Golden Member
Feb 2, 2012
1,764
274
126
You are talking about a single frame within 100. This is not what we get when we measure for minimum FPS. This is what we get when using FCAT or some other frame time software. You are talking about hickups, rather than anything over a period of time.

I'm not talking about a single frame within 100, I'm talking about 85 frames within 8558 (the benchmark in question had run for this long at the time of the screenshot). Minimum FPS is a different thing altogether (minimum FPS is the slowest frame of the 8558 frames). You certainly don't need FCAT or similar software/hardware to measure minimum framerate, FCAT is simply a tool that gives you more accurate frame times in general, but that goes for all of the frames measured, not just the slowest one (the slowest one being the minimum FPS).

The 85 frames in question are probably more or less evenly distributed across the benchmark in question and as suck are measured over a period of time (but they are of course not averaged across said period, since that's not how percentile values work).

While hickups can be annoying, if they are meaningful, they aren't the same thing as having a few seconds of 30 FPS. Most won't realize it even happened if it's close to the average minimum over a second.

You aren't going to see that single frame time hickup show up on a minimum FPS chart, unless it was a long enough frame to span most of a second.

There's really no such thing as the average minimum, only the minimum, which is a single data point (determined by the slowest frame). By extension there is no such thing as a minimum FPS chart, since you can't meaningfully chart a single data point.

You can however make a chart based on finding the minimum value within a moving window.

Also a frame time hickup most certainly does not have to span most of a second to show up on an FPS chart, for instance in the benchmark in question we can clearly see multiple frame time hickups or spikes, and none of those span anywhere close to a second (the graph cuts the top off, but most likely none of the spikes are above 50 ms).
 
Last edited:

bystander36

Diamond Member
Apr 1, 2013
5,154
132
106
I'm not talking about a single frame within 100, I'm talking about 85 frames within 8558 (the benchmark in question had run for this long at the time of the screenshot). Minimum FPS is a different thing altogether (minimum FPS is the slowest frame of the 8558 frames). You certainly don't need FCAT or similar software/hardware to measure minimum framerate, FCAT is simply a tool that gives you more accurate frame times in general, but that goes for all of the frames measured, not just the slowest one (the slowest one being the minimum FPS).

The 85 frames in question are probably more or less evenly distributed across the benchmark in question and as suck are measured over a period of time (but they are of course not averaged across said period, since that's not how percentile values work).



There's really no such thing as the average minimum, only the minimum, which is a single data point (determined by the slowest frame). By extension there is know such thing as a minimum FPS chart, since you can't meaningfully chart a single data point.

What you are talking about is essentially charting all the frame times that falls a certain amount below the average, which coincidentally is exactly what the 99th percentile metric is all about. Whether you chart them as frame times or FPS is irrelevant, since these are just inverse values.

Also a frame time hickup most certainly does not have to span most of a second to show up on an FPS chart, for instance in the benchmark in question we can clearly see multiple frame time hickups or spikes, and none of those span anywhere close to a second (the graph cuts the top off, but most likely none of the spikes are above 50 ms).
Have you setup FRAPs or similar software before? In FRAPs, 1 second is the minimum time frame to gather your FPS unless altered. In MSI Afterburner, 300 ms is the minimum time frame they give FPS. Anything that happens faster gets averaged out.

Is it possible the minimum FPS got down to those 85 frames? Yes, but it's not likely those 85 frames happened at the same time. These minimum frames you see in charts are not from a single frame in at least most cases, unless they go into their software to alter the default values.

If they did it from a single slow frame, I no for certain some of these Unigine benchmarks would show minimums of 2-4 FPS, instead of 30, because they include some massive frame hickups in some of them that span at least 1/4-1/2 of a second.

Clearly you have your own ideas, so we don't need to keep going on about it.
 

Krteq

Senior member
May 22, 2015
993
672
136
Sorry mate, you are wrong. FPS are extrapolated from frametimes in all cases. There is no method how to measure rendered frames per single second.
 
Last edited:

antihelten

Golden Member
Feb 2, 2012
1,764
274
126
Have you setup FRAPs or similar software before? In FRAPs, 1 second is the minimum time frame to gather your FPS unless altered. In MSI Afterburner, 300 ms is the minimum time frame they give FPS. Anything that happens faster gets averaged out.

Yes I have used FRAPS, but clearly you haven't, otherwise you would know that FRAPS will capture individual frame times for each individual frame.

Is it possible the minimum FPS got down to those 85 frames? Yes, but it's not likely those 85 frames happened at the same time. These minimum frames you see in charts are not from a single frame in at least most cases, unless they go into their software to alter the default values.

If they did it from a single slow frame, I no for certain some of these Unigine benchmarks would show minimums of 2-4 FPS, instead of 30, because they include some massive frame hickups in some of them that span at least 1/4-1/2 of a second.

Clearly you have your own ideas, so we don't need to keep going on about it.

The only way the minimum value in an FPS chart is not from a single frame, is if the chart has been smoothed in some manner.

So if Unigine doesn't show the accurate minimum frame time value, then it must be because it employs smoothing of some manner.
 

bystander36

Diamond Member
Apr 1, 2013
5,154
132
106
Yes I have used FRAPS, but clearly you haven't, otherwise you would know that FRAPS will capture individual frame times for each individual frame.



The only way the minimum value in an FPS chart is not from a single frame, is if the chart has been smoothed in some manner.

So if Unigine doesn't show the accurate minimum frame time value, then it must be because it employs smoothing of some manner.
I just did a little testing of my own. I used Unigine Heaven for the test, as I know when the benchmark starts, there is always a nasty hickup which causes a low minimum, which does not exist through the rest of the benchmark.

I was watching MSI Afterburner track the frame times to start as well to help see frame times. I turned on FRAPS benchmark, then started the Unigine Benchmark.

I saw a 55ms frame time spike (less than 20 FPS if it continued).
Unigine saw a minimum of 32.7 FPS.
FRAPS saw a minimum of 67 FPS.

It does seem that neither goes off frame times. It would also appear that the time frame they use to gather a minimum varies as well.

EDIT: Going through the frame times file, FRAPS shows the maximum frame time as 86.292, which would put the min FPS around 12, had it used the lowest frame time to determine minimum FPS.
 
Last edited:

antihelten

Golden Member
Feb 2, 2012
1,764
274
126
I just did a little testing of my own. I used Unigine Heaven for the test, as I know when the benchmark starts, there is always a nasty hickup which causes a low minimum, which does not exist through the rest of the benchmark.

I was watching MSI Afterburner track the frame times to start as well to help see frame times. I turned on FRAPS benchmark, then started the Unigine Benchmark.

I saw a 55ms frame time spike (less than 20 FPS if it continued).
Unigine saw a minimum of 32.7 FPS.
FRAPS saw a minimum of 67 FPS.

It does seem that neither goes off frame times. It would also appear that the time frame they use to gather a minimum varies as well.

FRAPS can produce different logs, the frametime log will give you the frame times for each individual frame, whereas the FPS log simply averages the frame times over one second (which is in effect the same as counting the number of frames over 1 second). The MinMaxAvg log is based on the FPS log.

So as I said they both work based on frame times (or if we want to be completely accurate they work based on timestamps, with the delta between timestamps being the frametime), but what they do with these frame times differ. By averaging frame times over one second you are effectively smoothing your data, which can obfuscate the existence of frame rate spikes. This is also why no one using FRAPS should ever use the FPS and MinMaxAvg functions for anything other than quick and dirty estimates.
 

bystander36

Diamond Member
Apr 1, 2013
5,154
132
106
FRAPS can produce different logs, the frametime log will give you the frame times for each individual frame, whereas the FPS log simply averages the frame times over one second (which is in effect the same as counting the number of frames over 1 second). The MinMaxAvg log is based on the FPS log.

So as I said they both work based on frame times (or if we want to be completely accurate they work based on timestamps, with the delta between timestamps being the frametime), but what they do with these frame times differ. By averaging frame times over one second you are effectively smoothing your data, which can obfuscate the existence of frame rate spikes. This is also why no one using FRAPS should ever use the FPS and MinMaxAvg functions for anything other than quick and dirty estimates.
Is that not what I've been saying all along? FRAPS, like most benchmark tools, will take your FPS over a minimum period of time. In FRAPS case, 1 second. I'm guessing Unigine's benchmark uses 1/2 a second by the results. The minimums that you see on these graphs are a result of the same type of techniques. Often directly from FRAPS.
 

antihelten

Golden Member
Feb 2, 2012
1,764
274
126
Is that not what I've been saying all along? FRAPS, like most benchmark tools, will take your FPS over a minimum period of time. In FRAPS case, 1 second. I'm guessing Unigine's benchmark uses 1/2 a second by the results. The minimums that you see on these graphs are a result of the same type of techniques. Often directly from FRAPS.

The whole point is that this isn't a real minimum FPS value, since it isn't the lowest value the game/benchmark ran at (which is the definition of a minimum). Furthermore FRAPS will only report this number if you use the MinMaxAvg function, but as I just explained to you, if you want to do any real analysis using FRAPS, then you should use the Frametimes function and only the Frametimes function, since anything else gives misleading results.

Either way I really don't know why we're still discussing this. At this point it should be obvious that FRAPS does in fact use frametimes (even if it doesn't report them when you use the FPS or MinMaxAvg function), and so does the Civ 6 benchmark. So all this talk about how random benchmarks like Unigine mangles and obfuscates the data is quite frankly irrelevant.
 

USER8000

Golden Member
Jun 23, 2012
1,542
780
136
So has this fixed the relatively poor performance on AMD cards we saw in the Techpowerup review??
 

bystander36

Diamond Member
Apr 1, 2013
5,154
132
106
The whole point is that this isn't a real minimum FPS value, since it isn't the lowest value the game/benchmark ran at (which is the definition of a minimum). Furthermore FRAPS will only report this number if you use the MinMaxAvg function, but as I just explained to you, if you want to do any real analysis using FRAPS, then you should use the Frametimes function and only the Frametimes function, since anything else gives misleading results.

Either way I really don't know why we're still discussing this. At this point it should be obvious that FRAPS does in fact use frametimes (even if it doesn't report them when you use the FPS or MinMaxAvg function), and so does the Civ 6 benchmark. So all this talk about how random benchmarks like Unigine mangles and obfuscates the data is quite frankly irrelevant.
The point is, a single frame in a second worth of frames is pretty insignificant and why we look at the minimums over a second.

I might also add, you were harping on me saying 40 FPS minimums was wrong, which is only true if you use your own personal having to use the single slowest frame. I was getting my data from the min/ave charts and the way most of us view it.
 

Sweepr

Diamond Member
May 12, 2006
5,148
1,142
131
DX12 results are in, from GameGPU:

- 1050 faster than 460 4GB @ 1080p
- 1060 6GB beating RX 480 8GB in all resolutions
- 1070 ahead of 980 Ti (and Fury X) in all resolutions
- 980 Ti (stock) faster than Fury X at 1080p/1440p, slower at 4K

Looks like this Gaming Evolved title favors NVIDIA.





 
Last edited:

kondziowy

Senior member
Feb 19, 2016
212
188
116
Without green glasses that you are wearing, it looks like it runs good on everything. Also even on Nvidia we see reduced CPU overhead by going from DX11 to DX12. i5-2500k goes from 37/44 to 44/59 fps. Looks like nobody got gimped as usually with Gaming Evolved titles. Only Intel and AMD hardware consistently gain in new APIs. <wink face>

Highlight of the day:
470 is 55% faster than 1050Ti.
 
Reactions: AtenRa

Sweepr

Diamond Member
May 12, 2006
5,148
1,142
131
I'm sorry, the highlight is, by far, GTX 1060 beating RX 480 in a Gaming Evolved title at DX12 mode. Around 10% faster at 1440p/4K.

Without green glasses that you are wearing

The results are not my fault.
 
Last edited:

kondziowy

Senior member
Feb 19, 2016
212
188
116
1060 is beating it by 1fps average and 3 in minimum. That's hardly a highlight. 470 and 1050Ti price gap is very small and as 460 is not worth a buy, so is 1050Ti. 1060 should be faster than 480 because we know for sure it will not gain but lose performance over time. It better beat 480 now even by 1 fps.
 
sale-70-410-exam    | Exam-200-125-pdf    | we-sale-70-410-exam    | hot-sale-70-410-exam    | Latest-exam-700-603-Dumps    | Dumps-98-363-exams-date    | Certs-200-125-date    | Dumps-300-075-exams-date    | hot-sale-book-C8010-726-book    | Hot-Sale-200-310-Exam    | Exam-Description-200-310-dumps?    | hot-sale-book-200-125-book    | Latest-Updated-300-209-Exam    | Dumps-210-260-exams-date    | Download-200-125-Exam-PDF    | Exam-Description-300-101-dumps    | Certs-300-101-date    | Hot-Sale-300-075-Exam    | Latest-exam-200-125-Dumps    | Exam-Description-200-125-dumps    | Latest-Updated-300-075-Exam    | hot-sale-book-210-260-book    | Dumps-200-901-exams-date    | Certs-200-901-date    | Latest-exam-1Z0-062-Dumps    | Hot-Sale-1Z0-062-Exam    | Certs-CSSLP-date    | 100%-Pass-70-383-Exams    | Latest-JN0-360-real-exam-questions    | 100%-Pass-4A0-100-Real-Exam-Questions    | Dumps-300-135-exams-date    | Passed-200-105-Tech-Exams    | Latest-Updated-200-310-Exam    | Download-300-070-Exam-PDF    | Hot-Sale-JN0-360-Exam    | 100%-Pass-JN0-360-Exams    | 100%-Pass-JN0-360-Real-Exam-Questions    | Dumps-JN0-360-exams-date    | Exam-Description-1Z0-876-dumps    | Latest-exam-1Z0-876-Dumps    | Dumps-HPE0-Y53-exams-date    | 2017-Latest-HPE0-Y53-Exam    | 100%-Pass-HPE0-Y53-Real-Exam-Questions    | Pass-4A0-100-Exam    | Latest-4A0-100-Questions    | Dumps-98-365-exams-date    | 2017-Latest-98-365-Exam    | 100%-Pass-VCS-254-Exams    | 2017-Latest-VCS-273-Exam    | Dumps-200-355-exams-date    | 2017-Latest-300-320-Exam    | Pass-300-101-Exam    | 100%-Pass-300-115-Exams    |
http://www.portvapes.co.uk/    | http://www.portvapes.co.uk/    |