Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 10
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2651 times and has 9 replies Next Thread
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
HST1 - Linux v Windows comparative performance test

As already indicated in other threads **, am underway in doing a comparison on a dual boot, Ubuntu 14.04 LTS with 4.2.1 kernel and Windows 10-Pro, both 64 bit, CPU Q6600 locked to stock speed of 2.4Ghz.

The Linux part is done, having completed 3 T400 and 1 T300. This has established that within T400 there can be a variance of nearly an hour, depending on Batch number.

7.14 HST1_000115_000056_AT0019_T300_F00056_S00001_1 20:22:07 (20:11:14) 4/12/2016 10:54:59 AM 4/12/2016 10:58:59 AM 99,11 211.38 MB 240.96 MB
7.14 HST1_000628_000003_AT0008_T400_F00028_S00001_1 18:14:01 (18:03:34) 4/12/2016 9:48:55 AM 4/12/2016 9:49:57 AM 99,04 183.17 MB 246.35 MB
7.14 HST1_000601_000071_AC0021_T400_F00096_S00001_1 19:23:23 (19:06:15) 4/12/2016 4:05:14 AM 4/12/2016 4:08:15 AM 99,12 181.28 MB 250.80 MB
7.14 HST1_000601_000066_AC0021_T400_F00091_S00001_1 19:12:42 (19:02:43) 4/11/2016 2:59:48 PM 4/11/2016 3:00:48 PM 99,13 196.00 MB 260.15 MB

With an efficiency of > 99%, at least we know that I/O on this platform is not an issue [There's discussion of systems having many many > 32 threads. Not a topic here... a problem of the few blessed with such horsepower!]

Upon booting into W10-64 Pro, managed to immediately fetch 4. The OS on same machine has never given > 98% efficiency, in fact on the 4 that ran previously at 1.6Ghz of T325 type, never got above 97.6%, after 37 hours of computing, but still a small deviation.

7.14 hst1 HST1_000650_000005_KC0007_T400_F00030_S00001_1 00:21:05 (00:16:46) 79,56 1,082 01d,08:07:38 09d,23 4/12/2016 12 PM [1] 00:05:21 69.49 MB 106.11 MB
7.14 hst1 HST1_000650_000091_KC0008_T400_F00016_S00001_1 00:21:05 (00:16:46) 79,55 1,071 01d,08:27:26 09d,23 4/12/2016 12 PM [1] 00:05:27 69.18 MB 105.76 MB
7.14 hst1 HST1_000650_000090_KC0008_T400_F00015_S00001_0 00:21:02 (00:16:43) 79,49 1,084 01d,08:00:00 09d,23 4/12/2016 12 PM [1] 00:05:21 70.10 MB 106.77 MB
7.14 hst1 HST1_000650_000014_KC0007_T400_F00039_S00001_1 00:20:58 (00:16:42) 79,66 1,072 01d,08:15:35 09d,23 4/12/2016 12 PM [1] 00:05:17 68.60 MB 105.08 MB

Using the <fraction_done_exact/> tag in app_config has previously proven to provide quite accurate prediction on the completion time [for started tasks], so these have kicked off with 1 day, 8 hours, but initial efficiency is sodden, just 80%. This is on my side a known issue and main reason of not using W10 other than for testing. Cold booting into W10 instead of taking it out of hibernation kicks off all sorts of update and indexing processes in W10 that lasts for hours and hours [given up of stopping them]. Still waiting on the fast-ring update build 10586 as a subscribers, this is still build 10240. At any rate, it's the CPU time comparison moi is after.

TTYL [Earliest tomorrow afternoon at this rate of progress].

** Someone, I think in the Beta forum, laid claim on there being 20% difference in performance between Linux and Windows, without any documenting that I can recollect, so this is a first attempt of backing up the numbers, whatever the outcome will be.
[Apr 12, 2016 10:40:11 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: HST1 - Linux v Windows comparative performance test

Good info to have. Thank you for the testing and soon to see differences.
----------------------------------------
[Edit 1 times, last edit by Former Member at Apr 12, 2016 11:22:57 AM]
[Apr 12, 2016 11:22:30 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Rickjb
Veteran Cruncher
Australia
Joined: Sep 17, 2006
Post Count: 666
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HST1 - Linux v Windows comparative performance test

Hi Sek ...
During the HST1 beta tests, I found that the HST1-beta WUs ran about 15% faster inder Linux-x64 (in VMs) than under Win 7 x64 (native), running concurrently on the same machines.
That's a ballpark figure from my mental arithmetic after just looking at the CPU times - I didn't do any exact calculations.
It also assumes that the Linux & Windows WUs needed the same amount of CPU activity (FPOPS).
I expect you'll find similar results for the production HST1 WUs. If you manage to download any that is :)

I recently did a similar comparison for FAHB. Again, no exact calculations, but FAHB ran about 10-15% slower on Linux.
And of course OET and other VINA projects run much faster under Linux.
I haven't compared MCM, UGM or CEP2.

HTH, and thanks for the incredible amount of personal time that you devote to WCG.
[Apr 13, 2016 5:08:21 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Crystal Pellet
Veteran Cruncher
Joined: May 21, 2008
Post Count: 1406
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HST1 - Linux v Windows comparative performance test

On same hardware:

Average run time with Linux 26.84 hours and with Windows 28.08 hours.
[Apr 13, 2016 7:52:08 AM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: HST1 - Linux v Windows comparative performance test

Well, after 21 hours CPU time and 6 more to go, the difference for a same-same (T400) controlled environment is heading for 27-19 = 8 hours differential, 40%+ slower on Windows, or the other way around, Linux being 30% faster than Windows.

Would have been better when getting the 4 of batch 650 to immediately boot into the other platform and get 4 of same batch, process them and boot back, to then do the first 4, but chances of that are small.

Fortunately, I have access to a very large data set which may allow to look at all the different batches processed by a same machine and draw comparisons from batch to batch. One machine ran multiple of 601 in ~16:10 and 628 in ~14:05, and has multiple of 641 and 656 in IP of the T400. Will see how those come out.

For now, initial indications confirm the rumor... Linux is faster [did make sure that 64 bit science apps were running in both cases]. Anyone who had T400 AND of batches 601, 628 and 650 on the same machine under Windows [or numbers very close to those 3] is asked to write in and tell about their CPU times, so we have a one platform runtime reference [differential indicators]. Not very sciency, but if 15% plus becomes a good number, it pays to boot into Linux, if you can and max throughput.

TTYL [once again]
[Apr 13, 2016 8:30:42 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Falconet
Master Cruncher
Portugal
Joined: Mar 9, 2009
Post Count: 3315
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HST1 - Linux v Windows comparative performance test

Yay so I wasn't imagining things :D

Linux power :D
----------------------------------------


- AMD Ryzen 5 1600AF 6C/12T 3.2 GHz - 85W
- AMD Ryzen 5 2500U 4C/8T 2.0 GHz - 28W
- AMD Ryzen 7 7730U 8C/16T 3.0 GHz
[Apr 14, 2016 8:19:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
KLiK
Master Cruncher
Croatia
Joined: Nov 13, 2006
Post Count: 3108
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HST1 - Linux v Windows comparative performance test

thx
----------------------------------------
oldies:UDgrid.org & PS3 Life@home


non-profit org. Play4Life in Zagreb, Croatia
[Apr 15, 2016 8:47:57 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Seoulpowergrid
Veteran Cruncher
Joined: Apr 12, 2013
Post Count: 823
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HST1 - Linux v Windows comparative performance test

Good info to know, thanks much.
----------------------------------------

[Apr 15, 2016 8:58:10 AM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: HST1 - Linux v Windows comparative performance test

Right at this time there's only an 'indicative' for lack of regular supply to allow fetching work on both platforms of same batch. Ran a second set on W10-64 Pro of Batch 686 which was 2+ hours faster, but still 26 hours, then went back to Linux so grab another set, but got none until one of 716, which is about to complete in 15.5 hours, close to the time of the OP set. For now, a Q6600, non-HT suggests that W10-74 for sure on same is no match. Different CPU's may give different results, to overall picture being... HST on Linux Ubuntu, the most prevalent and easy to use, is material.

The W10-64 Set 2.4Ghz:

7.14 hst1 HST1_000686_000010_MC0018_T400_F00035_S00001_1 01d,02:23:46 (01d,01:48:02)
7.14 hst1 HST1_000686_000063_MC0018_T400_F00088_S00001_0 01d,02:24:47 (01d,01:49:15)
7.14 hst1 HST1_000686_000022_MC0018_T400_F00047_S00001_1 01d,02:20:00 (01d,01:44:28)

7.14 hst1 HST1_000650_000014_KC0007_T400_F00039_S00001_1 01d,05:15:06 (01d,03:57:42)
7.14 hst1 HST1_000650_000091_KC0008_T400_F00016_S00001_1 01d,04:55:47 (01d,03:38:52)
7.14 hst1 HST1_000650_000005_KC0007_T400_F00030_S00001_1 01d,04:50:58 (01d,03:33:56)
7.14 hst1 HST1_000650_000090_KC0008_T400_F00015_S00001_0 01d,04:38:20 (01d,03:20:29)

The Ubuntu 14.04.04 LTS Set 2.4Ghz

7.14 hst1 HST1_000716_000058_MT0019_T400_F00083_S00001_0 15:28:16 (15:37:47)
7.14 hst1 HST1_000628_000003_AT0008_T400_F00028_S00001_1 18:14:01 (18:03:34)
7.14 hst1 HST1_000601_000071_AC0021_T400_F00096_S00001_1 19:23:23 (19:06:15)
7.14 hst1 HST1_000601_000066_AC0021_T400_F00091_S00001_1 19:12:42 (19:02:43)

If 716 is comparable to 686, then the differential is even greater than 40% on my dual boot system, for T400. Lots more than others see. (I dare not average at this time as the mixes/weighting of different runtime lengths on such small populations can serious stag the numbers. For sure, I'll be booting into Ubuntu whence I get my crunching-only W8.1 -4770 file server also dual booted.

BTW, at one point is was found that 32 bit app builds could be faster than their 64bit. The BOINC servers were supposed to actively discover this by sending 10-20 of each and when a particular bit size was found to be faster, to then send those by preference without need of user action. We'll see if rumors surface.

P.S. I'm sure techs could run advanced stats on what they have to give indication, but maybe they do not like the volunteers to know (where there's cheer, there's complaints, whine and mope).

Edit: Efficiency... It's a toss. 99+% efficiency on Linux, 95.4-97.7% on W10. Such differences add if having tasks that take 15-28 hours and longer. Worst case, 3.6% on 28 hours is 1 hour extra due that under W10 (my experience with this platform is not necessarily representative... the OS was not developed/optimized for 10+ years old CPU's)
----------------------------------------
[Edit 1 times, last edit by SekeRob* at Apr 15, 2016 9:36:10 AM]
[Apr 15, 2016 9:28:51 AM]   Link   Report threatening or abusive post: please login first  Go to top 
KLiK
Master Cruncher
Croatia
Joined: Nov 13, 2006
Post Count: 3108
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HST1 - Linux v Windows comparative performance test

Have 2 of the very similar computers (same MBO + same proc + same clock RAM speed) on Win10 vs. Ubuntu 14.04 LTS...will check the times on them & post here, when the WUs will arrive on them! ;)
----------------------------------------
oldies:UDgrid.org & PS3 Life@home


non-profit org. Play4Life in Zagreb, Croatia
----------------------------------------
[Edit 1 times, last edit by KLiK at Apr 15, 2016 10:05:59 AM]
[Apr 15, 2016 10:05:22 AM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread