What controls Turbo Core in Xeons?

[xeon_fan]

Hi could anyone post upgraded working version of Taichi x99 bios?
Thank you !

 

[knopflerbruce]

The odd timing issue I had was not an issue with the modded BIOS, might be the XMP profile. Works like it should on 4x8GB Kingston HyperX sticks. Also, I get alot of WHEA Parity Errors.

This stopped when I bumped the voltages a bit. I ran 1.6V Input, -70mV vcore and -50mV cache. I set these to 1.65V, -50mV and -40mV, respectively, and it's been running like a charm for half a day+. I might try to drop the input voltage and cache voltage a notch to be sure it was the vcore that was the issue. -70mV might be alot to ask for on some chips.

 

[CANONKONG]

• I had modified most bios for in need that if the CPU can not work stable with -70mv.Both BIOS with -50mv Vcoreoffset ffs,just flash and work.
• ASrock X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1slv2QiL ;
• MSI X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1qXOuUO8 ;
• EVGA X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1slhVG7b ;
• ASUS X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1boHZNbx ;
• GIGABYTE X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1pLG5FZ1 ;

 

[ange1us]

• I had modified most bios for in need that if the CPU can not work stable with -70mv.Both BIOS with -50mv Vcoreoffset ffs,just flash and work.
• ASrock X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1slv2QiL ;
• MSI X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1qXOuUO8 ;
• EVGA X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1slhVG7b ;
• ASUS X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1boHZNbx ;
• GIGABYTE X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1pLG5FZ1 ;

Thank you !! but I wonder is this work for my Asrock X99 WS with E5-2698V4?

or just for v3 only.

thanks.

 

[knopflerbruce]

May I ask what FFS is?

 

[CANONKONG]

Thank you !! but I wonder is this work for my Asrock X99 WS with E5-2698V4?

or just for v3 only.

thanks.

Just for v3 only

 

[Cata40]

• I had modified most bios for in need that if the CPU can not work stable with -70mv.Both BIOS with -50mv Vcoreoffset ffs,just flash and work.
• ASrock X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1slv2QiL ;
• MSI X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1qXOuUO8 ;
• EVGA X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1slhVG7b ;
• ASUS X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1boHZNbx ;
• GIGABYTE X99 mainboard wiht -50mv FFS MOD BIOS：http://pan.baidu.com/s/1pLG5FZ1 ;

Im not a proffessional it, but what diferences are betwheen these voltage differences?
Give more power when you have 120 with 50 or 70-50 vs. 50-50?
Or is it a processor and how much can it take?

 

[ange1us]

Just for v3 only

so sad,

is it possible to do this with xeon v4 es in the near future?

thank you

 

[xeon_fan]

Hi all, big thanks for all for the instructions! So far the gain is not great, compared to other results, but the processor was already @3.1Ghz at all 14 cores -> e5 2697 v3 [QS] now is @3.4 Ghz all cores.
Spec:
- Taichi x99
- e5 2697 v3 ES
Below are the screenshots with/without any BLCK changes (will try to overclock a bit, for x79 was able to get +107mhz, here I don't expect more than 105mhz):
Cinbench pre changes result - 2144/ 140
Cinbench unlocked turbo @100 mhz blck result 2319 /144
Cinbench unlocked turbo + 104.5 mhz 2443 / 148

links to photos:
http://imgur.com/a/Gxr0c @100 mhz BLCK

http://imgur.com/a/QnFeK @ 104.5 mhz BLCK

https://valid.x86.fr/hxs50m

 

[lucien_br]

You don't have to install the v3.efi anymore, you just need to instal the BIOS only. And the microcodes as the old way,most systems can automatic install by the systems itself,you can use tools to update the new one----3A microcode.

Thanks for the Asus Bios with EFI driver embedded. Works fine in 2696v3@x34 all 18-core with c-state on (c3 off) and no more crashes 100% stable! Using uCoce 39.
Where do I find the uCode 3A? >>> Edit: I found it!
Thanks!
Edit:
What is the advantage of µCode 3A over 39, 27 and the original 36 (mcupdate_genuineIntel.dll)?
Thanks!

 

[MOF]

Asrock EP2C612D16C-4L(bios v2.40) and single 2696V3 ES (SR1XK). 18 core 3.3ghz %100 stable with v3x2_50_39_vcc.efi.

 

[MOF]

I found hidden cpu overclock, memory timing and current control settings inside the Asrock server board bios. Thats can be enabled or change with the AMIBCP.exe (AMI BIOS Configuration Program). Alot of current and limitation configuration settings is there

That was good news, bad news is all v3 efi drivers bypassing that settings.

 

[corinthos]

Asrock EP2C612D16C-4L(bios v2.40) and single 2696V3 ES (SR1XK). 18 core 3.3ghz %100 stable with v3x2_50_39_vcc.efi.

Do you have to disable any C-states to make it work, or have to disable or modify anything else that may limit functionality?

Do you think you could get the same 3.3ghz if doing dual processor?

 

[MOF]

Do you have to disable any C-states to make it work, or have to disable or modify anything else that may limit functionality?

Nope, C3 was disabled on factory settings but i turned on for testing, nothing changed, works perfect. Also C6 enabled. No crash, no BSOD, no freeze, looks like everythings ok.

Update: Running the computer without the efi driver, c6 causes problems. With efi driver everythings fine.

Do you think you could get the same 3.3ghz if doing dual processor?

I think so. Why not?
Looks like everything works perfect with single cpu. Dual cpu will works too.

 

[Cata40]

Im not a proffessional it, but what diferences are betwheen these voltage differences?
Give more power when you have 120 with 50 or 70-50 vs. 50-50?
Or is it a processor and how much can it take?

you dont answer to my previous question, about different voltage!
Thats last bios with 50-20 work perfect and i can to work with 101.4 fsb

 

[MOF]

you dont answer to my previous question, about different voltage!
Thats last bios with 50-20 work perfect and i can to work with 101.4 fsb

I'm not sure but these values must be minus(-) vcore and uncore voltage offsets.

 

[CANONKONG]

Which BIOS are you using? There's a bug with some Haswell that can cause EDP throttling even when sufficient current is set so to rule that out we need to set unlimited current.


Ahh, I assumed you were reading 61E from the CPU. Try the MSR walker under the function tab of this utility http://crystalmark.info/software/CrystalCPUID/index-e.html If you set it to walk from 0x615 to 0x620 do you see 0x61E? If you are trying to write to this MSR and it does not exist a fault will occur in which if not handled may cause a BSOD / freeze.

The total number of Xeon's I have had including this one is one. It would be nice to test on some others, including 306f1 and 306f0 but doesn't look like it is going to happen.

Not MCHBAR for Xeon, 64-bit power limit is also in Bus 0xFF, Dev 1E, Func 0, reg 0xE8

If the Xeon does not support ratio overclocking then setting it will probably be ignored. One can check with HWiNFO under CPU properties. I have only seen this on mobile Haswell and it was mobile CPU's that have been unlocked, not desktop or Xeon that I am aware of. Obviously not many people interested in unlocking mobile CPU's

Can it work if we make something change to 0x648 0x649 0x64a 0x64b?
MWAIT C-States.....................: 270624
MSR_CORE_THREAD_COUNT......(0x35) : 0x40008
MSR_PLATFORM_INFO..........(0xCE) : 0x80838F3012800
MSR_PMG_CST_CONFIG_CONTROL.(0xE2) : 0x1E000005
MSR_PMG_IO_CAPTURE_BASE....(0xE4) : 0x21814
IA32_MPERF.................(0xE7) : 0x117B1ECDA2
IA32_APERF.................(0xE8) : 0x11F10A3A19
MSR_FLEX_RATIO.............(0x194) : 0xE0000
MSR_IA32_PERF_STATUS.......(0x198) : 0x286900002C00
MSR_IA32_PERF_CONTROL......(0x199) : 0x2C00
IA32_CLOCK_MODULATION......(0x19A) : 0x0
IA32_THERM_STATUS..........(0x19C) : 0x88450000
IA32_MISC_ENABLES..........(0x1A0) : 0x850089
MSR_MISC_PWR_MGMT..........(0x1AA) : 0x1
MSR_TURBO_RATIO_LIMIT......(0x1AD) : 0x2C2C2C2C
IA32_ENERGY_PERF_BIAS......(0x1B0) : 0x5
MSR_POWER_CTL..............(0x1FC) : 0x4005F
MSR_RAPL_POWER_UNIT........(0x606) : 0xA0E03
MSR_PKG_POWER_LIMIT........(0x610) : 0xFFD00000EA82
MSR_PKG_ENERGY_STATUS......(0x611) : 0x7034F1
MSR_PKGC3_IRTL.............(0x60a) : 0x8842
MSR_PKGC6_IRTL.............(0x60b) : 0x8873
MSR_PKGC7_IRTL.............(0x60c) : 0x8891
MSR_PP0_CURRENT_CONFIG.....(0x601) : 0x1F40
MSR_PP0_POWER_LIMIT........(0x638) : 0xFFD0
MSR_PP0_ENERGY_STATUS......(0x639) : 0x4ED5FB
MSR_PP0_POLICY.............(0x63a) : 0x0
MSR_CONFIG_TDP_NOMINAL.....(0x648) : 0x28
MSR_CONFIG_TDP_LEVEL1......(0x649) : 0x0
MSR_CONFIG_TDP_LEVEL2......(0x64a) : 0x0
MSR_CONFIG_TDP_CONTROL.....(0x64b) : 0x80000000
MSR_TURBO_ACTIVATION_RATIO.(0x64c) : 0x0
MSR_PKG_C2_RESIDENCY.......(0x60d) : 0x0
MSR_PKG_C3_RESIDENCY.......(0x3f8) : 0x0
MSR_PKG_C6_RESIDENCY.......(0x3f9) : 0x0
MSR_PKG_C7_RESIDENCY.......(0x3fa) : 0x0

 

[CANONKONG]

I will prepare some custom bioses in the Next days. Let me know which board exactly and which efi.

Can it work if we make something change to 0x648 0x649 0x64a 0x64b?
MWAIT C-States.....................: 270624
MSR_CORE_THREAD_COUNT......(0x35) : 0x40008
MSR_PLATFORM_INFO..........(0xCE) : 0x80838F3012800
MSR_PMG_CST_CONFIG_CONTROL.(0xE2) : 0x1E000005
MSR_PMG_IO_CAPTURE_BASE....(0xE4) : 0x21814
IA32_MPERF.................(0xE7) : 0x117B1ECDA2
IA32_APERF.................(0xE8) : 0x11F10A3A19
MSR_FLEX_RATIO.............(0x194) : 0xE0000
MSR_IA32_PERF_STATUS.......(0x198) : 0x286900002C00
MSR_IA32_PERF_CONTROL......(0x199) : 0x2C00
IA32_CLOCK_MODULATION......(0x19A) : 0x0
IA32_THERM_STATUS..........(0x19C) : 0x88450000
IA32_MISC_ENABLES..........(0x1A0) : 0x850089
MSR_MISC_PWR_MGMT..........(0x1AA) : 0x1
MSR_TURBO_RATIO_LIMIT......(0x1AD) : 0x2C2C2C2C
IA32_ENERGY_PERF_BIAS......(0x1B0) : 0x5
MSR_POWER_CTL..............(0x1FC) : 0x4005F
MSR_RAPL_POWER_UNIT........(0x606) : 0xA0E03
MSR_PKG_POWER_LIMIT........(0x610) : 0xFFD00000EA82
MSR_PKG_ENERGY_STATUS......(0x611) : 0x7034F1
MSR_PKGC3_IRTL.............(0x60a) : 0x8842
MSR_PKGC6_IRTL.............(0x60b) : 0x8873
MSR_PKGC7_IRTL.............(0x60c) : 0x8891
MSR_PP0_CURRENT_CONFIG.....(0x601) : 0x1F40
MSR_PP0_POWER_LIMIT........(0x638) : 0xFFD0
MSR_PP0_ENERGY_STATUS......(0x639) : 0x4ED5FB
MSR_PP0_POLICY.............(0x63a) : 0x0
MSR_CONFIG_TDP_NOMINAL.....(0x648) : 0x28
MSR_CONFIG_TDP_LEVEL1......(0x649) : 0x0
MSR_CONFIG_TDP_LEVEL2......(0x64a) : 0x0
MSR_CONFIG_TDP_CONTROL.....(0x64b) : 0x80000000
MSR_TURBO_ACTIVATION_RATIO.(0x64c) : 0x0
MSR_PKG_C2_RESIDENCY.......(0x60d) : 0x0
MSR_PKG_C3_RESIDENCY.......(0x3f8) : 0x0
MSR_PKG_C6_RESIDENCY.......(0x3f9) : 0x0
MSR_PKG_C7_RESIDENCY.......(0x3fa) : 0x0

 

[Dufus]

Can it work if we make something change to 0x648 0x649 0x64a 0x64b?

Well cTDP does not seem function on my 2683 but why would you want to configure for lower clocks/power? If you were thinking of modifying the values then these are usually read only settings so unless one has knowledge of the workings of microcode patches and the means to modify them or knows of some secret bypass setting then nothing to do.

What is the relevance to posting registers of an unlocked quad core CPU?

Update: Running the computer without the efi driver, c6 causes problems. With efi driver everythings fine.

Is that CC6 or PC6 (core or package state C6)?

 

[Zladimir]

@MOF so many different variables for throttling one just has to do what one can. The biggest problem I personally see is with AVX2, this seems to operate via a VID table, that is it seems to try and keep core VID below a certain value and what ratio one gets is tied to that.

Here's an example running just one thread with affinity set, just a simply loop, no AVX2. Turbo in yellow.

Spoiler

CPU runs at it's max 30x ratio


Now see what happens when we run just one AVX2 opcode once every 50 milliseconds on one thread of each core.

Spoiler

Power control gets ready for AVX2 by slamming down the ratio to 25x and from what I am led to believe leaves it there for 1 millisecond after the last AVX2 instruction before returning to the top ratio, 30x in this case. The irony in this case is that it doesn't even run the AVX2 as 256bit but needs a warm up period. Some info on Agner Fog's blog, for instance http://www.agner.org/optimize/blog/read.php?i=387. Limit reasons shows EDP logged, with the event being logged in yellow.

Now if we run the same opcode once every millisecond

Spoiler

Ratio is now dropping to 25x and we can see EDP continually active (red) and only using 37W of power, no current or power throttling..

Interesting, did you tried with or without disabled vcoms ?

@Dufus, might it be possible that setting vcom/fivr faults is per domain, or is it global ? Im actually not home, so I cant test it out.

Anyway did you made different observation with FIVR fault/efficiency disabled ?

Dufus thanks for your other points. When Im home Ill look into them depending on my time.

 

[MOF]

Is that CC6 or PC6 (core or package state C6)?

• Package C State Support "CPU C6 (Retention) state"
• Cpu C6 State "enable"

This setup doesnt work without efi

• Package C State Support "CPU C6 (non-Retention) state"
• Cpu C6 State "enable"

works fine without efi driver.

• Package C State Support "CPU C6 (Retention) state"
• Cpu C6 State "disable"

also works too.

 

[Cata40]

I'm not sure but these values must be minus(-) vcore and uncore voltage offsets.

I ask because performance is about the same with those different voltaje
I suspect it's for different processors

 

[jeanlu]

Hey, I would need some help. I own a asrock extreme 4 motherboard, I downloaded bios with -70mv offset, I can get all the cores run to 3.2ghz when the max reached by GTZ member was 3.5ghz on all cores. I don't know why I can't reach max turbo core of 3.5ghz. Maybe a bios with -100 would make it work? Can someone do it for me? Am I missing something? Thanks!!!!!!!

 

[Alex Chang]

• Thanks to dufus and C_payne share their sourse code,if they don't share the sourse code,we will not have E5V3 tubor boost,thanks again!
• I had made most MOD BIOS for in need.
• MOD BIOS TOOLS AND FFS FILES：http://pan.baidu.com/s/1qY0THJQ；
• ASrock X99 mainboard wiht FFS MOD BIOS：http://pan.baidu.com/s/1nvG8Zfr ；
• MSI X99 mainboard wiht FFS MOD BIOS：http://pan.baidu.com/s/1jHHeOvG；
• EVGA X99 mainboard wiht FFS MOD BIOS：http://pan.baidu.com/s/1slJOHDr；
• ASUS X99 mainboard removed Microcode MOD BIOS：http://pan.baidu.com/s/1kVFrs15；
• GIGABYTE X99 mainboard removed Microcode MOD BIOS：http://pan.baidu.com/s/1hsGJrSS；
• GIGABYTE X99 mainboard wiht FFS MOD BIOS：http://pan.baidu.com/s/1i5OOHbn
• GIGABYTE NEED EFIFLASH MOD TOOL to flash the MOD BIOS：http://pan.baidu.com/s/1dEUMqDN

Hi CANONKONG,

I read articles and did a ASUS "X99-A II" mainboard removed Microcode MOD BIOS already, but still don't know how to mod FFS BIOS, could you modify it for me?
The download page here : https://www.asus.com/us/Motherboards/X99-A-II/HelpDesk_BIOS/
Direct download link here : http://dlcdnet.asus.com/pub/ASUS/mb/LGA2011/X99-A_II/X99-A-II-ASUS-1701.zip

Thank in advance!

 

[jeanlu]

Hello CANONKONG,

Since I can't get more than 3.0ghz on all cores with -50 bios and 3.2ghz on -70 bios, maybe it would work with -100?
Would you please make a bios for ASROCK EXTREME 4 with -100?
And thank you very much for what you already did!
Many thanks!