| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Active Research
Forum: Africa Rainfall Project
Thread: How full of load can I go? |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 22
|
|
| Author |
|
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 1317 Status: Offline Project Badges: 
|
@mdxi One question on your information - you refer to uplift, and I'd like to be sure I understand your numbers; are those numbers the amount of extra work you got by running twice as many threads or a measure of how much faster individual jobs ran when not hyperthreading It's the ratio of WUs completed in 24 hours with SMT vs the WUs completed in 24 hours without SMT. So 15 WUs with SMT versus 10 WUs without, would be a 1.5X uplift. Thanks very much for the clarification. Thanks also for the link to your web page on Ryzen performance -- very interesting! For what it's worth, when I did my tests ages ago I was effectively using the reciprocal of your measure - how much slower were individual tasks on average... And if I invert your numbers they aren't that dissimilar from what I saw! However, my testing was somewhat more "off the cuff" than yours appears to have been so the percentage error would be higher on mine!!! Once again, many thanks. |
||
|
|
Jim1348
Veteran Cruncher USA Joined: Jul 13, 2009 Post Count: 1066 Status: Offline Project Badges: 
|
The good news is that I am now running three ARP1 on my Ryzen 2700 (Ubuntu 18.04.3). The bad news is that they are pushing out the times of the MIP1 to around three hours. They normally run 1 hour 45 minutes, and I always limit them to two MIP1 at a time.
----------------------------------------So I will try limiting ARP1 to two at a time also and see if that fixes it. EDIT: It does not appear to be working. At least the estimated completion time for the MIP1s keeps increasing. I will just have to run them on separate machines. The Ryzen 3600 should be good for the ARP1s, since it has a lot of cache per core. [Edit 2 times, last edit by Jim1348 at Nov 20, 2019 6:06:02 PM] |
||
|
|
fuzzydice555
Advanced Cruncher Joined: Mar 25, 2015 Post Count: 89 Status: Offline Project Badges:
|
EDIT: It does not appear to be working. At least the estimated completion time for the MIP1s keeps increasing. I will just have to run them on separate machines. The Ryzen 3600 should be good for the ARP1s, since it has a lot of cache per core. Can you check what happens if you only have 3 ARP + MIP (1 ARP & 2 MIP for example) overall? If ARP needs the same amount of cache as MIP (5MB), limiting the overall number of ARP + MIP to 3 for the Ryzen 2700 should solve the issue.  |
||
|
|
Jim1348
Veteran Cruncher USA Joined: Jul 13, 2009 Post Count: 1066 Status: Offline Project Badges:
|
Can you check what happens if you only have 3 ARP + MIP (1 ARP & 2 MIP for example) overall? Yes, I can do that. I have been running 3 ARP + 1 MIP + 12 MCM (so that all cores are working) for the past few hours. The first MIP finished in 2 hours 1 minute The second MIP finished in 2 hours 40 minutes And the current MIP, now at 67.5% complete, is estimated to take 2 hours 47 minutes. So that probably is a little better than before, but not perfect. I don't really know that cache is the limitation; that is just one of the usual suspects. But it could be I/O or some arithmetic unit. I think you just have to check out each chip and see. Have fun, and thanks for the question. |
||
|
|
Jim1348
Veteran Cruncher USA Joined: Jul 13, 2009 Post Count: 1066 Status: Offline Project Badges:
|
I did another test, this time on a Ryzen 1700 (also Ubuntu 18.04.3) that is more encouraging.
This time I was running 1 ARP + 1 MIP + 14 MCM. The first MIP completed in 47 minutes, and the second one in 2 hours 8 minutes. After that, the ARP ended, and I can't do any more on that machine. But I think that is perfectly normal, and is probably the best way to run them if you want both ARP and MIP on the same machine. |
||
|
|
5TEVE
Cruncher Joined: Sep 4, 2006 Post Count: 34 Status: Offline Project Badges: 
|
I'm running 8 ARP Wu's right now on my Laptop plus 1 Einstein GPU Wu, the ARP's appear to take about 28 Hr's so they finish in time. The Laptop has 64gb of Memory so not worried about that ...
---------------------------------------- |
||
|
|
fuzzydice555
Advanced Cruncher Joined: Mar 25, 2015 Post Count: 89 Status: Offline Project Badges:
|
I did another test, this time on a Ryzen 1700 (also Ubuntu 18.04.3) that is more encouraging. This time I was running 1 ARP + 1 MIP + 14 MCM. The first MIP completed in 47 minutes, and the second one in 2 hours 8 minutes. After that, the ARP ended, and I can't do any more on that machine. But I think that is perfectly normal, and is probably the best way to run them if you want both ARP and MIP on the same machine. Thanks! I've set the 2 MIP + 1 ARP as the limit, at least until I change to Ryzen 3000 with more cache.  |
||
|
|
retsof
Former Community Advisor USA Joined: Jul 31, 2005 Post Count: 6824 Status: Offline Project Badges: 
|
I was running one of my oldest computers AMD with 8 threads at 60% CPU time and it actually filled up with 8 ARP. The download may have taken a little longer but isn't much in the grand scheme of things. Bad news. It is probably that L3 cache thrashing problem mentioned in the ARP forum. If more than a couple run simultaneously, run time gets very long. I could tell that the remaining time stayed about the same for several minutes, and then dropped a bit and did the same. They wouldn't even finish before deadline and I aborted all but one. The remaining time for the one active then dropped off in a more normal manner. I aborted one at a time and the remaining didn't look normal until I only saw one thread active with ARP. When this project was added, it only suggested 1 ARP in each of the four BOINC settings (default, home, school, work) and I am going with that, ONE ARP thread per computer. maximum.
----------------------------------------P.S. The all or remaining threads can all occupy themselves with MIP or MCM unless one of the rare HSTB shows up.
SUPPORT ADVISOR
----------------------------------------Work+GPU i7 8700 12threads School i7 4770 8threads Default+GPU Ryzen 7 3700X 16threads Ryzen 7 3800X 16 threads Ryzen 9 3900X 24threads Home i7 3540M 4threads50% [Edit 3 times, last edit by retsof at Nov 24, 2019 12:50:32 PM] |
||
|
|
retsof
Former Community Advisor USA Joined: Jul 31, 2005 Post Count: 6824 Status: Offline Project Badges:
|
One of my team members says that there isn't much difference in only running one ARP at a time and loading up the computer. Has something been fixed to solve the L3 cache thrashing problem.
----------------------------------------It might also be a difference in the way Intel and AMD handle things.
SUPPORT ADVISOR
Work+GPU i7 8700 12threads School i7 4770 8threads Default+GPU Ryzen 7 3700X 16threads Ryzen 7 3800X 16 threads Ryzen 9 3900X 24threads Home i7 3540M 4threads50% |
||
|
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12594 Status: Offline Project Badges:
|
My i7-3770 with 20 GB RAM is happily running 2 arp1, 2 mip1, 4 mcm1 plus 1 Einstein on GPU (nominally 0.5 CPU + 1 GPU).
Mike |
||
|
|
|