| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Active Research
Forum: OpenPandemics - COVID-19 Project
Thread: Hyperthreading.... |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 53
|
|
| Author |
|
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7846 Status: Offline Project Badges: 
|
Yes. You could use the API to download your finished tasks for each of the machines under the specs you proposed and compare between the machines.
----------------------------------------Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
|
Aurum
Master Cruncher The Great Basin Joined: Dec 24, 2017 Post Count: 2391 Status: Offline Project Badges: 
|
Yes. You could use the API to download your finished tasks for each of the machines under the specs you proposed and compare between the machines. Then I would have to learn what an API is :-)Cheers That might be easier than what I was thinking. My stats have been fairly level for weeks now so I thought I could disable HTing on all my computers, but, they're all headless. So I was looking for a way to do it remotely and found this script to disable HT: #!/bin/bash and this one to enable HT:for cpu in /sys/devices/system/cpu/cpu[1-9]*; do if [ -e "$cpu/topology/thread_siblings_list" ]; then sibling=$(awk -F '[^0-9]' '{ print $2 }' $cpu/topology/thread_siblings_list) if [ ! -z $sibling ]; then echo 0 > "/sys/devices/system/cpu/cpu$sibling/online" fi fi done #!/bin/bash But I don't understand what cpu[1-9]* means and how to change it for different CPUs.for cpu in /sys/devices/system/cpu/cpu[1-9]*; do echo 1 > "$cpu/online" done At the bottom of the page: https://askubuntu.com/questions/942728/disable-hyper-threading-in-ubuntu I think the answer may be in here: https://www.kernel.org/doc/Documentation/admin-guide/cputopology.rst   ...KRI please cancel all shadow-banning[Edit 2 times, last edit by Aurum420 at Jun 7, 2020 6:42:07 PM] |
||
|
|
Aurum
Master Cruncher The Great Basin Joined: Dec 24, 2017 Post Count: 2391 Status: Offline Project Badges:
|
I invoked that incantation above and it did not work. Trying API but I doubt that will work unless there's options not in the Help file. I tried this and it only gave me 250 results for any and all computers:
----------------------------------------worldcommunitygrid.org/api/members/aurum420/results?code=VCode&format=xml&ServerState=5&Outcome=1&SortBy=DeviceId&Limit=500Is there a way to limit output to DeviceName=Rig-32 or DeviceId=6860633 ??? Is there an option to DL a csv? ...KRI please cancel all shadow-banning[Edit 2 times, last edit by Aurum420 at Jun 7, 2020 7:36:36 PM] |
||
|
|
Aurum
Master Cruncher The Great Basin Joined: Dec 24, 2017 Post Count: 2391 Status: Offline Project Badges:
|
There's something happening here but it's not exactly clear:
---------------------------------------- Oops, it's an i9-9960X. The lone ARP WU finished while I was making this graph and when I checked back I see the OPN WUs are running much faster now. Could ARP be clogging up the cache? ...KRI please cancel all shadow-banning[Edit 2 times, last edit by Aurum420 at Jun 7, 2020 8:48:39 PM] |
||
|
|
Jim1348
Veteran Cruncher USA Joined: Jul 13, 2009 Post Count: 1066 Status: Offline Project Badges: 
|
So what resources are shared with various WCG projects??? Is there an a priori prediction whether HT helps or not??? The resources are just those in the CPU core (arithmetic units, etc.). I believe the OS determines what instruction goes into which of the two threads, corresponding to the two logical cores. There is nothing otherwise "a priori". You get what it gives you, typically a 30% gain in output per (physical) core in most projects. So that means that each virtual core runs about 65% as fast as a physical core. It can vary from about 20 to 40%. Some compilers do better than others with hyperthreading. As a rule, HT always helps, but there are the cache considerations. Some projects take more than others. If you run out of cache, then you might be better cutting down on the virtual cores; CPDN is a good example for their N216 work units. Here on WCG, MIP also does strange things, which is usually attributed to cache, but it might be some other shared resource. But the run of the mill projects (including OPN insofar as I can see) gain from HT. |
||
|
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2346 Status: Recently Active Project Badges: 
|
When a filename matches the pattern 'cpu[0-9]*' it means that the filename starts with the letters 'cpu' and it is followed by one or more digits.
Example: cpu16 I tried this and it only gave me 250 results for any and all computers: You can use Limit=0 to download all results in one go.worldcommunitygrid.org/api/members/aurum420/results?code=VCode&format=xml&ServerState=5&Outcome=1&SortBy=DeviceId&Limit=500 Is there a way to limit output to DeviceName=Rig-32 or DeviceId=6860633 ??? No, but you could use some external computer program to select the device names after downloading all results.Is there an option to DL a csv? Only if you use some external computer program, like wcgresults, to convert XML or JSON directly to CSV or TSV.Example: $ wcgresults -daf my_results.tsv -l0 |
||
|
|
Macromancer
Veteran Cruncher United States Joined: Sep 6, 2016 Post Count: 994 Status: Offline Project Badges: 
|
Is there an option to DL a csv? Others have posted how to do this via Linux. If you're using Win10 and don't have access to Linux and/or you just want to do it in Win10, I wrote a simple PowerShell script that outputs this: Name Valid ElapsedTime Return Date Return Time DeviceName ---- ----- ----------- ---------- ---------- ---------- OPN1_0001715_06784_0 1 2.87 hrs 6/7/2020 01:47:39 UTC Ryzen 5 1600 OPN1_0001715_06789_0 1 2.64 hrs 6/7/2020 01:47:39 UTC Ryzen 5 1600 OPN1_0001639_03722_1 1 2.72 hrs 6/7/2020 01:47:43 UTC Ryzen 5 1600 OPN1_0001832_00530_0 1 2.88 hrs 6/7/2020 01:47:43 UTC Ryzen 5 1600 . . . . . It has filters that are trivially changed to select what you want, e.g. I only wanted to see my valid OPN1 results. I can put the script on here if you want it. Macromancer |
||
|
|
Aurum
Master Cruncher The Great Basin Joined: Dec 24, 2017 Post Count: 2391 Status: Offline Project Badges:
|
adriverhoef, I tried to DL your script with both chrome & firefox and it's filled with non-UTF-8 characters. Helaas, pindakaas. I'd sure like to use it. Is there a way to clean copy?
----------------------------------------...KRI please cancel all shadow-banning[Edit 1 times, last edit by Aurum420 at Jun 9, 2020 12:16:45 PM] |
||
|
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2346 Status: Recently Active Project Badges:
|
adriverhoef, I tried to DL your script with both chrome & firefox and it's filled with non-UTF-8 characters. Helaas, pindakaas. I'd sure like to use it. Is there a way to clean copy? Right. Let me reproduce this. So you go to the address of wcgresults (where you see that Firefox doesn't display the UTF-8 characters correctly, unless you click: View → Text encoding → Unicode) and then you press ctrl-S for downloading in Firefox. Firefox doesn't know that the file contains UTF-8 characters, so it (probably) displays the file in your default character set. It goes without saying, after downloading the file, you should open the file with a UTF-8 capable editor. Alternatively, if you still have troubles, you could download the file as follows: $ wget https://a3a3.home.xs4all.nl/wcg/wcgresults PS. Helaes peanutbutter is available in stores, too.  [Edit 2 times, last edit by adriverhoef at Jun 9, 2020 12:59:35 PM] |
||
|
|
Aurum
Master Cruncher The Great Basin Joined: Dec 24, 2017 Post Count: 2391 Status: Offline Project Badges:
|
---------------------------------------- ...KRI please cancel all shadow-banning |
||
|
|
|