| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
| World Community Grid Forums
|
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 10
|
|
| Author |
|
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
As already indicated in other threads **, am underway in doing a comparison on a dual boot, Ubuntu 14.04 LTS with 4.2.1 kernel and Windows 10-Pro, both 64 bit, CPU Q6600 locked to stock speed of 2.4Ghz.
The Linux part is done, having completed 3 T400 and 1 T300. This has established that within T400 there can be a variance of nearly an hour, depending on Batch number. 7.14 HST1_000115_000056_AT0019_T300_F00056_S00001_1 20:22:07 (20:11:14) 4/12/2016 10:54:59 AM 4/12/2016 10:58:59 AM 99,11 211.38 MB 240.96 MB 7.14 HST1_000628_000003_AT0008_T400_F00028_S00001_1 18:14:01 (18:03:34) 4/12/2016 9:48:55 AM 4/12/2016 9:49:57 AM 99,04 183.17 MB 246.35 MB 7.14 HST1_000601_000071_AC0021_T400_F00096_S00001_1 19:23:23 (19:06:15) 4/12/2016 4:05:14 AM 4/12/2016 4:08:15 AM 99,12 181.28 MB 250.80 MB 7.14 HST1_000601_000066_AC0021_T400_F00091_S00001_1 19:12:42 (19:02:43) 4/11/2016 2:59:48 PM 4/11/2016 3:00:48 PM 99,13 196.00 MB 260.15 MB With an efficiency of > 99%, at least we know that I/O on this platform is not an issue [There's discussion of systems having many many > 32 threads. Not a topic here... a problem of the few blessed with such horsepower!] Upon booting into W10-64 Pro, managed to immediately fetch 4. The OS on same machine has never given > 98% efficiency, in fact on the 4 that ran previously at 1.6Ghz of T325 type, never got above 97.6%, after 37 hours of computing, but still a small deviation. 7.14 hst1 HST1_000650_000005_KC0007_T400_F00030_S00001_1 00:21:05 (00:16:46) 79,56 1,082 01d,08:07:38 09d,23 4/12/2016 12 PM [1] 00:05:21 69.49 MB 106.11 MB 7.14 hst1 HST1_000650_000091_KC0008_T400_F00016_S00001_1 00:21:05 (00:16:46) 79,55 1,071 01d,08:27:26 09d,23 4/12/2016 12 PM [1] 00:05:27 69.18 MB 105.76 MB 7.14 hst1 HST1_000650_000090_KC0008_T400_F00015_S00001_0 00:21:02 (00:16:43) 79,49 1,084 01d,08:00:00 09d,23 4/12/2016 12 PM [1] 00:05:21 70.10 MB 106.77 MB 7.14 hst1 HST1_000650_000014_KC0007_T400_F00039_S00001_1 00:20:58 (00:16:42) 79,66 1,072 01d,08:15:35 09d,23 4/12/2016 12 PM [1] 00:05:17 68.60 MB 105.08 MB Using the <fraction_done_exact/> tag in app_config has previously proven to provide quite accurate prediction on the completion time [for started tasks], so these have kicked off with 1 day, 8 hours, but initial efficiency is sodden, just 80%. This is on my side a known issue and main reason of not using W10 other than for testing. Cold booting into W10 instead of taking it out of hibernation kicks off all sorts of update and indexing processes in W10 that lasts for hours and hours [given up of stopping them]. Still waiting on the fast-ring update build 10586 as a subscribers, this is still build 10240. At any rate, it's the CPU time comparison moi is after. TTYL [Earliest tomorrow afternoon at this rate of progress]. ** Someone, I think in the Beta forum, laid claim on there being 20% difference in performance between Linux and Windows, without any documenting that I can recollect, so this is a first attempt of backing up the numbers, whatever the outcome will be. |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Good info to have. Thank you for the testing and soon to see differences.
----------------------------------------[Edit 1 times, last edit by Former Member at Apr 12, 2016 11:22:57 AM] |
||
|
|
Rickjb
Veteran Cruncher Australia Joined: Sep 17, 2006 Post Count: 666 Status: Offline Project Badges:
|
Hi Sek ...
During the HST1 beta tests, I found that the HST1-beta WUs ran about 15% faster inder Linux-x64 (in VMs) than under Win 7 x64 (native), running concurrently on the same machines. That's a ballpark figure from my mental arithmetic after just looking at the CPU times - I didn't do any exact calculations. It also assumes that the Linux & Windows WUs needed the same amount of CPU activity (FPOPS). I expect you'll find similar results for the production HST1 WUs. If you manage to download any that is :) I recently did a similar comparison for FAHB. Again, no exact calculations, but FAHB ran about 10-15% slower on Linux. And of course OET and other VINA projects run much faster under Linux. I haven't compared MCM, UGM or CEP2. HTH, and thanks for the incredible amount of personal time that you devote to WCG. |
||
|
|
Crystal Pellet
Veteran Cruncher Joined: May 21, 2008 Post Count: 1406 Status: Offline Project Badges:
|
On same hardware:
Average run time with Linux 26.84 hours and with Windows 28.08 hours. |
||
|
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
Well, after 21 hours CPU time and 6 more to go, the difference for a same-same (T400) controlled environment is heading for 27-19 = 8 hours differential, 40%+ slower on Windows, or the other way around, Linux being 30% faster than Windows.
Would have been better when getting the 4 of batch 650 to immediately boot into the other platform and get 4 of same batch, process them and boot back, to then do the first 4, but chances of that are small. Fortunately, I have access to a very large data set which may allow to look at all the different batches processed by a same machine and draw comparisons from batch to batch. One machine ran multiple of 601 in ~16:10 and 628 in ~14:05, and has multiple of 641 and 656 in IP of the T400. Will see how those come out. For now, initial indications confirm the rumor... Linux is faster [did make sure that 64 bit science apps were running in both cases]. Anyone who had T400 AND of batches 601, 628 and 650 on the same machine under Windows [or numbers very close to those 3] is asked to write in and tell about their CPU times, so we have a one platform runtime reference [differential indicators]. Not very sciency, but if 15% plus becomes a good number, it pays to boot into Linux, if you can and max throughput. TTYL [once again] |
||
|
|
Falconet
Master Cruncher Portugal Joined: Mar 9, 2009 Post Count: 3315 Status: Offline Project Badges:
|
Yay so I wasn't imagining things :D
----------------------------------------Linux power :D ![]() - AMD Ryzen 5 1600AF 6C/12T 3.2 GHz - 85W - AMD Ryzen 5 2500U 4C/8T 2.0 GHz - 28W - AMD Ryzen 7 7730U 8C/16T 3.0 GHz |
||
|
|
KLiK
Master Cruncher Croatia Joined: Nov 13, 2006 Post Count: 3108 Status: Offline Project Badges:
|
thx
---------------------------------------- |
||
|
|
Seoulpowergrid
Veteran Cruncher Joined: Apr 12, 2013 Post Count: 823 Status: Offline Project Badges:
|
Good info to know, thanks much.
----------------------------------------![]() |
||
|
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
Right at this time there's only an 'indicative' for lack of regular supply to allow fetching work on both platforms of same batch. Ran a second set on W10-64 Pro of Batch 686 which was 2+ hours faster, but still 26 hours, then went back to Linux so grab another set, but got none until one of 716, which is about to complete in 15.5 hours, close to the time of the OP set. For now, a Q6600, non-HT suggests that W10-74 for sure on same is no match. Different CPU's may give different results, to overall picture being... HST on Linux Ubuntu, the most prevalent and easy to use, is material.
----------------------------------------The W10-64 Set 2.4Ghz: 7.14 hst1 HST1_000686_000010_MC0018_T400_F00035_S00001_1 01d,02:23:46 (01d,01:48:02) 7.14 hst1 HST1_000686_000063_MC0018_T400_F00088_S00001_0 01d,02:24:47 (01d,01:49:15) 7.14 hst1 HST1_000686_000022_MC0018_T400_F00047_S00001_1 01d,02:20:00 (01d,01:44:28) 7.14 hst1 HST1_000650_000014_KC0007_T400_F00039_S00001_1 01d,05:15:06 (01d,03:57:42) 7.14 hst1 HST1_000650_000091_KC0008_T400_F00016_S00001_1 01d,04:55:47 (01d,03:38:52) 7.14 hst1 HST1_000650_000005_KC0007_T400_F00030_S00001_1 01d,04:50:58 (01d,03:33:56) 7.14 hst1 HST1_000650_000090_KC0008_T400_F00015_S00001_0 01d,04:38:20 (01d,03:20:29) The Ubuntu 14.04.04 LTS Set 2.4Ghz 7.14 hst1 HST1_000716_000058_MT0019_T400_F00083_S00001_0 15:28:16 (15:37:47) 7.14 hst1 HST1_000628_000003_AT0008_T400_F00028_S00001_1 18:14:01 (18:03:34) 7.14 hst1 HST1_000601_000071_AC0021_T400_F00096_S00001_1 19:23:23 (19:06:15) 7.14 hst1 HST1_000601_000066_AC0021_T400_F00091_S00001_1 19:12:42 (19:02:43) If 716 is comparable to 686, then the differential is even greater than 40% on my dual boot system, for T400. Lots more than others see. (I dare not average at this time as the mixes/weighting of different runtime lengths on such small populations can serious stag the numbers. For sure, I'll be booting into Ubuntu whence I get my crunching-only W8.1 -4770 file server also dual booted. BTW, at one point is was found that 32 bit app builds could be faster than their 64bit. The BOINC servers were supposed to actively discover this by sending 10-20 of each and when a particular bit size was found to be faster, to then send those by preference without need of user action. We'll see if rumors surface. P.S. I'm sure techs could run advanced stats on what they have to give indication, but maybe they do not like the volunteers to know (where there's cheer, there's complaints, whine and mope). Edit: Efficiency... It's a toss. 99+% efficiency on Linux, 95.4-97.7% on W10. Such differences add if having tasks that take 15-28 hours and longer. Worst case, 3.6% on 28 hours is 1 hour extra due that under W10 (my experience with this platform is not necessarily representative... the OS was not developed/optimized for 10+ years old CPU's) [Edit 1 times, last edit by SekeRob* at Apr 15, 2016 9:36:10 AM] |
||
|
|
KLiK
Master Cruncher Croatia Joined: Nov 13, 2006 Post Count: 3108 Status: Offline Project Badges:
|
Have 2 of the very similar computers (same MBO + same proc + same clock RAM speed) on Win10 vs. Ubuntu 14.04 LTS...will check the times on them & post here, when the WUs will arrive on them! ;)
-------------------------------------------------------------------------------- [Edit 1 times, last edit by KLiK at Apr 15, 2016 10:05:59 AM] |
||
|
|
|