| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Active Research
Forum: Africa Rainfall Project
Thread: Work Available |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 3595
|
|
| Author |
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
My team is in one of the challenges for ARP only and it's interesting that out of 31 teams, only 8 of those teams even get ARP units and out of those 8, one team has over 4 times as many ARP than the next team. I suspect there are machines out there pulling every single ARP unit the minute it's offered, making the odds swing wildly away from 1 in 1000. 23 teams have zero ARP results (although it's only been a day or two since the challenge started).
https://www.worldcommunitygrid.org/team/chall...lenge.do?challengeId=9745 That's a pretty top-heavy looking list of teams and doesn't "seem like natural distribution" to my eye. $0.02 |
||
|
|
DCS1955
Veteran Cruncher USA Joined: May 24, 2016 Post Count: 668 Status: Offline Project Badges: 
|
I got my first randomized ARP on my "New" Reconditioned desktop. A i5 4690 3.5Ghz (Single thread Passmark 2218) with 16 G Ram AND a SSD. So another data point. Someone posted that the awarded points is the average of the two claimed points. Your machine is more than double the performance of your wingman. This processor executed this WU like greased lightning (predicted 1d 3h/ actual 14.25H) vs 38 WU Average period of 2D 14hr. on a (i7 3720QM@2.6GHz (Passmark Single Thread Rating 1820) 12 GRam/HD) Both running Win 10. I am new to SSD could that be the reason for such a large performance improvement?   |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
The ARP1 create work is still running as expected. It has been loading 21 new workunits every 30 minutes. ... Remember, that with workunits that require redundancy, it takes it a bit to show validation keeping up. It usually tails by about how long the deadlines are. OK, if you're happy Keith! It must mostly be 'cos I'm running Linux then Thanks, -Uplinger  . As always, thanks for replying. |
||
|
|
D_S_Spence
Advanced Cruncher Canada Joined: Jan 5, 2017 Post Count: 118 Status: Offline Project Badges: 
|
My 3.1GHz i5-2400 running Linux Mint has been completing ARP units in about 15 hours. It's not a new fast computer by any means (I got it around 2012 I think) but I put an SSD in it before signing it up to WCG this fall.
|
||
|
|
nanoprobe
Master Cruncher Classified Joined: Aug 29, 2008 Post Count: 2998 Status: Offline Project Badges: 
|
And with maybe 42000 threads chasing 42 units, that is only 1 in a 1000, but why so many references to other platforms? Mike Always been like that IIRC.
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.
  |
||
|
|
nanoprobe
Master Cruncher Classified Joined: Aug 29, 2008 Post Count: 2998 Status: Offline Project Badges:
|
The ARP1 create work is still running as expected. It has been loading 21 new workunits every 30 minutes. ... Remember, that with workunits that require redundancy, it takes it a bit to show validation keeping up. It usually tails by about how long the deadlines are. OK, if you're happy Keith! It must mostly be 'cos I'm running Linux then Thanks, -Uplinger . As always, thanks for replying.FWIW I've been getting windoze tasks more frequently than Linux from the start. Guessing 6 to 1.
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.
|
||
|
|
DCS1955
Veteran Cruncher USA Joined: May 24, 2016 Post Count: 668 Status: Offline Project Badges:
|
The ARP1 create work is still running as expected. It has been loading 21 new workunits every 30 minutes. ... Remember, that with workunits that require redundancy, it takes it a bit to show validation keeping up. It usually tails by about how long the deadlines are. OK, if you're happy Keith! It must mostly be 'cos I'm running Linux then Thanks, -Uplinger . As always, thanks for replying.FWIW I've been getting windoze tasks more frequently than Linux from the start. Guessing 6 to 1. Could that be due to the WU assigner having to find a pair OS types and there are more processors using windows vs linux. |
||
|
|
nanoprobe
Master Cruncher Classified Joined: Aug 29, 2008 Post Count: 2998 Status: Offline Project Badges:
|
The ARP1 create work is still running as expected. It has been loading 21 new workunits every 30 minutes. ... Remember, that with workunits that require redundancy, it takes it a bit to show validation keeping up. It usually tails by about how long the deadlines are. OK, if you're happy Keith! It must mostly be 'cos I'm running Linux then Thanks, -Uplinger . As always, thanks for replying.FWIW I've been getting windoze tasks more frequently than Linux from the start. Guessing 6 to 1. Could that be due to the WU assigner having to find a pair OS types and there are more processors using windows vs linux. No idea. Seems to me that shouldn't matter. Send_0 to one linux host and send _1 to the next linux host that queries.  Received 11 tasks in the last 24 hours. 9 windoze, 2 linux and the 2 linux were more than 14 hours ago.
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.
----------------------------------------[Edit 1 times, last edit by nanoprobe at Dec 2, 2019 8:55:20 PM] |
||
|
|
DrMason
Senior Cruncher Joined: Mar 16, 2007 Post Count: 153 Status: Offline Project Badges: 
|
My team is in one of the challenges for ARP only and it's interesting that out of 31 teams, only 8 of those teams even get ARP units and out of those 8, one team has over 4 times as many ARP than the next team. I suspect there are machines out there pulling every single ARP unit the minute it's offered, making the odds swing wildly away from 1 in 1000. 23 teams have zero ARP results (although it's only been a day or two since the challenge started). https://www.worldcommunitygrid.org/team/chall...lenge.do?challengeId=9745 That's a pretty top-heavy looking list of teams and doesn't "seem like natural distribution" to my eye. $0.02 Hmmm... I mean, that's my team, and a large portion of those ARP points are mine (at least 70k, maybe more). I really don't know what to say. It looks top-heavy, yeah, but if my own contribution is the norm in the team, I'm not aware of anything untoward going on. I have my cache numbers set as close to 0 as possible, so it just crunches units and requests work when a unit finishes. So, it's not like I'm trying to fill a cache with days of scarce units or anything. I've described my exact cache and project selection method earlier in the thread. Quoted here for easy access. The approach I use kind of assumes that the internet is not interrupted, and that work is constantly being done and reported, so it may not work for everyone. But my approach is that I use mainly the device manager. If the cache is set very low, it will fetch new work whenever a project finishes crunching. I then adjust the projects to limit some and encourage the others. I check the boxes of just the one or two programs I want to encourage. Since those units are scarce, then I check the box to have WCG fill the rest of the threads with whatever other projects if none of the units I want are available. To maximize efficiency, I limit the number of MIP (since the level 3 cache requirements has a knock-on effect on other work units if too many MIP units are crunching at the same time), set the project I want to encourage to "unlimited" just in case, and then set the cancer units to a high enough number to fill the rest of the threads just in case. If you have few enough machines (or groups of similar machines), you can create a profile for each tailored to how much MIP to limit and how many threads to fill with cancer workunits (if HSTB or ARP aren't available), and then they never need babysitting again. But, it takes a fair amount of effort at the start haha. Now, what I do have that might give me an advantage are a number of dedicated crunching machines running Linux - 3 systems with Ryzen 7 1700s with 16 Gigs of Ram; an old decomissioned server I got on eBay with 32 cores, 64 Gigs of Ram, running Linux; and an EPYC dual-socket system with 32 cores and 64 Gigs of ram (also from decommissioned server parts on Ebay), also running Linux. Why Linux? Because it's free, haha, and most of the OS updates don't force a restart.  These crunch exclusively WCG 24/7.I get maybe 10 units a day to process, so not a huge amount of the daily amounts. Even with 176 dedicated cores, I don't have sapphire yet , and the points/results I submit daily for ARP are insignificant compared to the other projects I crunch. So, at the end of all of this, I'm not aware of anything I'm doing to game the system. If I somehow am, inadvertently, then maybe this will help everyone else get an extra unit or two. Best of luck to everyone!   |
||
|
|
nanoprobe
Master Cruncher Classified Joined: Aug 29, 2008 Post Count: 2998 Status: Offline Project Badges:
|
I suspect there are machines out there pulling every single ARP unit the minute it's offered, making the odds swing wildly away from 1 in 1000. 23 teams have zero ARP results (although it's only been a day or two since the challenge started). And just how do you suppose they are doing that? Sounds like you suspect they are somehow cheating.
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.
----------------------------------------[Edit 3 times, last edit by nanoprobe at Dec 2, 2019 9:49:17 PM] |
||
|
|
|