[arch3990]

...it's not a problem for me - I'm still not able to submit the Benchwell data with this type of CPUs (AMD Opteron 6282 ES):



...just to inform you

[eric nixon]

Can i ask, which mobo? and how much slower are normal 6282's? (are they also unlocked) nice machine you got there..

[arch3990]

Mainboard is the Supermicro H8QGi+-F (cheapest one ) - normal 6282 are not unlocked but more expensive
You have to look here for example:

http://www.ebay.com/itm/AMD-Opteron-ZS2 ... 3f32318861

[eric nixon]

Thanks, It seems like a complex subject, I was just reading this,

This is the reason for Tear's BIOS for non-ES chips (to change FSB) as well as TurionPowerControl for ES chips (to change the multiplier)

I like the idea of escaping from intels miserly offerings... but want to keep around 3.6ghz speed because I'm used to it.

[arch3990]

TurionPowerControl is very easy to use under WinX64 and a little bit more complex under UBUNTU but you can achieve very good results with these ES CPUs...

I achieved 4.10 GHz running CB 11.5 and I also achieved 4.00 GHz running Benchwell. These CPUs run smoothly with a 24/7 setup @3.60GHz running Maxwell Render as a rendernode.

http://hwbot.org/submission/2360263_ovi ... .91_points

[numerobis]

but want to keep around 3.6ghz speed because I'm used to it.

The problem is that you can't compare AMD GHz with Intel GHz because all AMD processors have a maybe 40% lower per core performance.
So maybe as a node it is ok, but i think not as workstation - and we are comparing 4 AMD Opterons to 2 Intel Xeons here.


btw. when i look at the benchwell list... i hope "gpucomputer.pl" is at least paying NL some money for being allowed to spam the list with useless advertising...

(and some others too like xxx.3DWS.NET or xxx.TREDDI.COM)


I would like to get some unlocked Ivy Xeon ES... but i don't know where to find them - the only sources i see are Hong Kong or China based ebay shops...

[vizport]

Pretty cool results. But I think a dual Intel system - if it could oc - would literally destroy this quad CPU setup. However the top dual Xeons are locked. I dream of my old SR-2 times. Still have some of them here @ 4GHz with 5650s. At least Intel and AMD could sell the most expensive Xeons unlocked. What a mess Intel creates with these new expensive 12-15cores delivering only tiny performance increase for their price

@numerobis
if you find some, let me know!

[arch3990]

Getting a complete quad Opteron setup for a little bit more than the price of one E5-2697 v2 is an option for me.

I have five of these Opteron ES setups here and they didn't cost more than 2.500 Euro per system (with an nvidia quadro FX1800 and a small fast SSD).

One of these setups, I even use as a workstation and its power consumption (idle) is lower than the power consumption of the workstation with the Intel 3930K (idle)

[Fernando Tella]

Interesting!

What was the benchmark in Maxwell?

[vizport]

@arch3990

You name it! The price is ridiculous for the intels.
Can you tell me something about power consumption of the quad setups. And is that 2500€ for ALL the components? How much RAM can the board take? Do you have liquid cooling? What are the temps @load? I need to setup a new renderserver with 512GB RAM and some serious computing power.

[arch3990]

@Fernando Tella

Benchwell V3 - results Opteron 6282ES



http://www.cpu-world.com/CPUs/Bulldozer ... %20SE.html


@ stock - 3m05s - 1505.62



@ 3.60GHz - 2m30s - 1855.76



@ 3.80GHz - 2m11s - 2123.90

@vizport

I will answer you later, because it is a little information to gather (including exact hardware configuration and prices...)

[arch3990]

@vizport

power consumption:

Two years ago we had to do some power consumption tests in the old office to exactly split the consumers. I don't have the exact numbers anymore but I remember that the 3990K setup (ASUS - Rampage, Geforce Quadro 4000) needed more than the setup with the 62xx Quad Opterons (Supermicro MB, Geforce Quadro FX1800) in idle mode. I was very surprised about that but I know that the Opterons are very efficient compared to Intel servers, regarding power consumption - it is one of their big advantages.

If I don't overclock I only need a common 850 Watt PSU...


configuration:

Render Node (in the cellar )
- Supermicro Mainboard - 615 Euro
- 4x Opteron 62xx ES (4x 16C) - ebay - 4x 230 Euro - 920 Euro
- 4x Dynatron A6 CPU cooler - 4x 35 Euro - 140 Euro
- 32GB (16x) DDR3 - 1333MHz - 240 Euro
- nvidia Quadro FX1800 - ebay but new - 60 Euro
- 120 GB SSD - 60 Euro
- LEPA G 1600W PSU - 220 Euro
- Xigmatek Elysium (Case) - 200 Euro

makes 2455 Euro

Workstation
- nvidia Quadro 4000 instead of nvidia Quadro FX1800 - ebay - 300 Euro
- 4x Noctua NH-U12 instead of Dynatron A6 - 4x 55 Euro - 220 Euro

makes 2775 Euro

...and looks like this:



I only use air cooling - the temperatures under several hours of heavy load / using Maxwell are around 60°C...

This is the Mainboard that I'm using:

http://www.supermicro.com/Aplus/motherb ... QGi_-F.cfm

it allows up to 1TB RAM...

[vizport]

Pretty cool results.Can you clock them even higher? I have each of my nodes cooled by a MORA3 Pro radiator allowing awesome performance. I can tell from your temps that your node could be safe @ ~4,5Ghz if on water. Can you up the vcore to test how far it goes on temps / stability? Or is there a limit / wall you are hitting?

[arch3990]

Pretty cool results.Can you clock them even higher? I have each of my nodes cooled by a MORA3 Pro radiator allowing awesome performance. I can tell from your temps that your node could be safe @ ~4,5Ghz if on water. Can you up the vcore to test how far it goes on temps / stability? Or is there a limit / wall you are hitting?

We are talking about an SR-2 setup? Yes these were pretty cool, running with LC (water) it was no problem to get 4.5 - 4.6 GHz under full load. One of my two SR-2 setups made 4m43s / 985.16 (2x X5680 / Noctua NH-D14) - Benchwell V2 - on air - sorry I don't remember the frequency

You can overclock the Opterons up to 4.60 GHz easily - but they don't run Benchwell with this frequency.
Because of Maxwell profits from CPU and memory performance the CPU (memory controller in the CPU!) is way more under load than for example benching Cinebench which runs completely in the CPU cache. Therefore you can go higher there...
I could run Benchwell V2 @4.0 GHz on the Opteron machine but when running Benchwell V3 @4.0 GHz the PSU (1600W) stops working after half a minute (CPU VCore @ 1.35V). The CPUs just need too much power - under load

Running Cinebench CB 11.5 & CB 15 is no problem with up to 4.20 GHz. Anything above, the same thing happens...

[vizport]

Ok I understand. These chips are real suckers if clocked high. However if you see the price of the setup against one intel cpu it makes a lot of sense.