Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 68
Posts: 68   Pages: 7   [ 1 2 3 4 5 6 7 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 11098 times and has 67 replies Next Thread
Mamajuanauk
Master Cruncher
United Kingdom
Joined: Dec 15, 2012
Post Count: 1900
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
MegaCruncher - Build Log (started, photos' added) Completed & Running!

Following the successful dual processor build logged here , the next build is a quad processor - 'MegaCruncher' the main components of which are listed below. The only one in question is the chassis, as new they cost fortunes and the only used on I can find a the time of writting the user is not replying to my communications. But I will still get it built and running on the bench if no chassis!
    1 x Chassis/Open case Arrived!
    1 x Corsair AX1200i PSU - Already got it!
    1 x Supermicro H8QG6-F motherboard Arrived
    4 x AMD Opteron 6274 (8 core, 16 thread x 4 = 64!) Arrived!
    4 x Noctua NH-U12DO A3 AMD Opteron CPU Cooler Socket G34 C32 F Heatsink Fan - Arrived! (before the temp passive ones)
    2 x Corsair Vengeance 16GB 4X4GB Quad Channel DDR3 1600MHz PC3-12800 DIMM Desktop (8Gb per socket to start, if it needs more then it will get it!) Arrived!

I'll start the build log in this post and answer questions as replies, your comments are most welcome!
Hardware




Processors are used and don't have boxes...

Now to the Build
Tray/case build underway

Frame completed (just the base to add)


Motherboard installed with main power connected - (cable routing needs sorting out)

Processors, Memory & First Cooler installed


That's it! All assembled and soon to be working!

After some issues it was up and running. Early indications show, temps as between 28 & 34C. However, 2 of the coolers blow through the other 2, so could reduce this by changing the orientation of the coolers on the CPU, if there's space! And I have made some improvement by adding the other 2 CPU fans.

This first registered on WCG just before 19:00 GMT and at the lunchtime update had matched enough work with the wingmen to amass 46.6k points.
01/20/2014 		0:011:07:50:01 		46,600 		68
01/19/2014 0:000:04:40:35 470 1


Power
Running flat out, 64 FAAH threads the meter says just under 600 watts. Less than I was expecting!

Noise, very quiet! actually quieter than my main Windows PC!

Please feel free to ask any questions and make comments and observations...

Note, as mentioned, my next build will be another on just like this! If it works out ok...

I'm looking at making this an enclosed case with some sace fans etc. I'll post some pictures when I complete it.

Tray size - (extenal) 64 x 39 cms approx

Thanks for your intrest/advice and comments. It's been fun, here's to the next one! biggrin


More to follow...
----------------------------------------
Mamajuanauk is the Name! Crunching is the Game!



----------------------------------------
[Edit 10 times, last edit by Mamajuanauk at Jan 21, 2014 3:44:28 PM]
[Jan 7, 2014 4:33:51 PM]   Link   Report threatening or abusive post: please login first  Go to top 
ryan222h
Senior Cruncher
Joined: Sep 4, 2006
Post Count: 425
Status: Offline
Reply to this Post  Reply with Quote 
Re: MegaCruncher - Build Log

Looking forward to this build and how it compares to my big Kahuna in ppw/h and total output.

Let me start by mentioning the chassis you picked has 3x 7500 RPM cooling fans and 3x 8200 RPM rear exhaust fan. In case you didn't know that means its going to be a screamer and probably unsuitable for a residential environment.

Unless you can disconnect those fans and use some other sort of a cooling arrangement, you might look at finding anther case. I've thought about constructing my own custom case with 120mm fans, and still may do so at some point.

Its possible that this chassis doesn't use the highest RPM setting unless it gets really hot, so you might be ok if the fan speeds stay down. Hard to know for sure until you can actually test it.
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by ryan222h at Jan 7, 2014 5:08:23 PM]
[Jan 7, 2014 5:06:31 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Mamajuanauk
Master Cruncher
United Kingdom
Joined: Dec 15, 2012
Post Count: 1900
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: MegaCruncher - Build Log

Yep, ryan, you are correct! It will not be going in doors!

You are also correct about the fan speeds, they only increase as the Temp increases, so shouldn't be too bad with luck!

I'm not sure this will be the case, as mentioned, the supplier is not responding to my communications. If he doesn't I'll be doing a custom case...
----------------------------------------
Mamajuanauk is the Name! Crunching is the Game!



[Jan 7, 2014 6:19:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Norton01
Cruncher
US
Joined: Feb 19, 2012
Post Count: 41
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: MegaCruncher - Build Log

Check this guy out for custom cases:

http://richchomiczewski.wordpress.com/home/trays/

I've seen a 4P in one up close and the build quality is excellent!

I have some pics around somewhere using the Supermicro board like yours and Noctua coolers for the chips.

Will try to locate and post if you would like smile

Congrats on the build- 4P's do great for crunching and folding! cool
----------------------------------------
[Jan 8, 2014 1:29:34 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Paul Schlaffer
Senior Cruncher
USA
Joined: Jun 12, 2005
Post Count: 279
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: MegaCruncher - Build Log

Mamajuanuk,
As you can see from my build I am a fan of the Opterons. Please let us know how it produces once you have a good 10+ days of run time in. FYI the 6274 is truly 16 cores per socket. There are no fake cores in the AMD world. Hyperthreading should be counterproductive in HPC applications. I also have the Noctua heatsinks, they are very good and quiet.

Congratulations!
----------------------------------------
“Where an excess of power prevails, property of no sort is duly respected. No man is safe in his opinions, his person, his faculties, or his possessions.” – James Madison (1792)
[Jan 8, 2014 4:45:08 AM]   Link   Report threatening or abusive post: please login first  Go to top 
ryan222h
Senior Cruncher
Joined: Sep 4, 2006
Post Count: 425
Status: Offline
Reply to this Post  Reply with Quote 
Re: MegaCruncher - Build Log

Mamajuanuk,
FYI the 6274 is truly 16 cores per socket. There are no fake cores in the AMD world. Hyperthreading should be counterproductive in HPC applications.


Not sure I agree with that statement. Interlagos and Bulldozer both share 1 Floating point unit between 2 Integer "cores". In my opinion that's basically the same as hyperthreading in the way that it makes "fake" cores by resource sharing.

However, Magny Cours is 1 for 1, having full resources per core. That's why I went that direction with my build.

If your crunching primarily depends on integer math computing its not a problem, but floating point intensive applications will suffer.
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by ryan222h at Jan 8, 2014 5:10:00 AM]
[Jan 8, 2014 5:08:19 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Bearcat
Master Cruncher
USA
Joined: Jan 6, 2007
Post Count: 2803
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: MegaCruncher - Build Log

Am curious about a few things crunching with 54 threads.
1. Hard disk bottle neck.
Will boinc keep everything in memory until written or page file it.
2. Memory.
How much memory is needed if Boinc keeps it everything in ram.
3. Hard drive speed.
Will a raptor hard drive be best?

Ryan, do you install boinc on the OS drive but data on a second drive? Any raid?
----------------------------------------
Crunching for humanity since 2007!

[Jan 8, 2014 1:57:22 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Thargor
Veteran Cruncher
UK
Joined: Feb 3, 2012
Post Count: 1291
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: MegaCruncher - Build Log

I'll also be very interested in seeing how this performs, in terms of power-usage, disk-access-limits, memory-usage, etc, as my planned build for some point in the next few months (have to have my boiler replaced at home, first) is very similar to yours:

Chassis: 1U SC818ATQ+1400
Motherboard: Quad AMD Opteron 6000 H8QGI+-F
CPU: 4 x AMD Opteron 6378 (16-core 2.4GHz)
RAM: 16 * 4GB DDR3 PC3-12800 ECC/Registered
RAID: LSi 9211-4i HBA SAS/SATA3 4-port
HDD: 2 x 250GB WD VelociRaptor 10K-RPM SATA3 in RAID-1 setup
PSU: 1400W 95% Efficiency

Not sure what fans are in it, but it's a full server-build from http://www.rackservers.com , so I'm assuming they're not going to skimp out - will be discussing it with them before I order, anyway, so cooling won't be an issue.
----------------------------------------

[Jan 8, 2014 2:24:37 PM]   Link   Report threatening or abusive post: please login first  Go to top 
ryan222h
Senior Cruncher
Joined: Sep 4, 2006
Post Count: 425
Status: Offline
Reply to this Post  Reply with Quote 
Re: MegaCruncher - Build Log

Am curious about a few things crunching with 54 threads.
1. Hard disk bottle neck.
Will boinc keep everything in memory until written or page file it.
2. Memory.
How much memory is needed if Boinc keeps it everything in ram.
3. Hard drive speed.
Will a raptor hard drive be best?

Ryan, do you install boinc on the OS drive but data on a second drive? Any raid?


I use an SSD instead of HD's, good for around 50,000 instructions per second so throughput should not be a problem. Everything is on the one drive. I have it set to not use the page file, not sure if this helps or hurts performance.

Running just 12gb of RAM on a 48 core cruncher and the system reports using only about 4gb of it at the moment, though its running Linux. Windows probably uses more.
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by ryan222h at Jan 8, 2014 3:36:17 PM]
[Jan 8, 2014 3:35:08 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Mamajuanauk
Master Cruncher
United Kingdom
Joined: Dec 15, 2012
Post Count: 1900
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: MegaCruncher - Build Log

Check this guy out for custom cases:

http://richchomiczewski.wordpress.com/home/trays/

I've seen a 4P in one up close and the build quality is excellent!

I have some pics around somewhere using the Supermicro board like yours and Noctua coolers for the chips.

Will try to locate and post if you would like smile

Congrats on the build- 4P's do great for crunching and folding! cool
Nice, I've been toying with the idea of building one out of the same Aluminium extrusion as the frame but with perspex as the sides etc.

I do like the ones made in the link, shame he is not making the size I'll need...

Thanks for the link!
----------------------------------------
Mamajuanauk is the Name! Crunching is the Game!



[Jan 8, 2014 7:47:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 68   Pages: 7   [ 1 2 3 4 5 6 7 | Next Page ]
[ Jump to Last Post ]
Post new Thread