| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Active Research
Forum: Africa Rainfall Project
Thread: For Current Volunteers: Advance Information on Our Newest Project |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 164
|
|
| Author |
|
|
Aurum
Master Cruncher The Great Basin Joined: Dec 24, 2017 Post Count: 2384 Status: Offline Project Badges: 
|
The WU would've been done in 1 day instead of 13.
----------------------------------------  ...KRI please cancel all shadow-banning[Edit 1 times, last edit by Aurum420 at Sep 7, 2020 11:52:08 AM] |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
The standard deadline is 7 days and evidently, with this volunteers running 160 hours, and probably more as the screenshot only lists the CPU time attributed as far as I can see, there's argument too for making it longer. The job was finished, it was validated.
Access to most all as is the intend of volunteer computing, to get as many as possible involved. Personally, I hardly watch except when MY device turns in an error, which I get alerted to in the daily API extract run. If not error, 99.9999999% of the time the crediting to the tally will arrive eventually. |
||
|
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 884 Status: Offline Project Badges: 
|
@Aurum420
One would think it wouldn't take too many of these to rethink their Quorum 2 policy: lavaflow has already explained why that particular case showed up; also, I wonder if that overrunning machine has a bigger queue than it can sustain... And I do wonder how often such cases actually happen - unfortunately, without the ability to analyse the total returns records we can only guess (and my guess is that it's uncommon!) With regards to abandoning Quorum 2 - if they did so for this experiment the science could not be considered valid! There would be no guarantee that a quorum 1 task actually returned a valid result; for instance, what if a machine has a small area of RAM that has a stuck bit problem but it usually happens to be in a data area and doesn't cause a crash or seriously out of range result that a validator could catch??? If that happened, an entire cell's calculations would be effectively invalid. I raise that possibility because the laptop from which I'm sending this post had exactly that problem when relatively new (there was a 128 MB block with a fair number of stuck bits) and I only noticed it when I started getting Invalid quorum 2 jobs on WCG - a pair of new memory sticks gave me both an upgrade and a return to valid results, but I wonder how many quorum one results I returned that happened to have data in that area but no obvious error resulted... (Fortunately, it probably didn't actually matter because of the nature of the quorum one projects!) Given that (as has been pointed out before) each ARP1 work unit represents the only task for a specific part of the total experimental area, they can't afford to have an unverified result, so the concept of trusted machine does not apply, being appropriate only for experiments which use multiple random views of the same data (e.g. FAH2, MIP1 and OPN1, or the climate simulations at CPDN) Hope this sheds some light - Al. |
||
|
|
Aurum
Master Cruncher The Great Basin Joined: Dec 24, 2017 Post Count: 2384 Status: Offline Project Badges:
|
...I wonder how many quorum one results I returned that happened to have data in that area but no obvious error resulted... Wouldn't they be listed as Invalids on Results Status? E.g., https://www.worldcommunitygrid.org/ms/viewBoi...By=sentTime&pageNum=1...KRI please cancel all shadow-banning |
||
|
|
Aurum
Master Cruncher The Great Basin Joined: Dec 24, 2017 Post Count: 2384 Status: Offline Project Badges:
|
adri, Would it be possible to use your script https://a3a3.home.xs4all.nl/wcg/wcgresults to extract all ARP WUs with 3 or more Valids awarded???
----------------------------------------...KRI please cancel all shadow-banning[Edit 1 times, last edit by Aurum420 at Sep 8, 2020 9:52:16 AM] |
||
|
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2104 Status: Offline Project Badges: 
|
adri, Would it be possible to use your script https://a3a3.home.xs4all.nl/wcg/wcgresults to extract all ARP WUs with 3 or more Valids awarded??? As far as I know you can't find this information through the API, these data are only available after clicking the Results Status button, so you would need a different program, one that is capable of scraping data from the Results Status page. You could use a program like wcgstats, it scrapes the results from the Results Status page and inspects each Result Name (result) to display its Workunit Status. Just a quick example of how it looks: $ wcgstats -w -m4 -s0 -p2 -QfNote: Here, the name of the device is listed as i5. Below, in another example, I have removed the names of the devices (and the options -Q and -f). Now, suppose you want to view all ARP1 results, then you would need to call the program wcgstats as follows: $ wcgstats -w -aARP1 ARP1_0008345_023_1-- Linux Debian - In Progress 9/8/20 05:37:56 9/15/20 05:37:56 0.00 0.0 / 0.0Notes: Only 15 results can be shown at a time due to website restrictions. When there are more than 15 results, the output will show the number of available pages. To show aborted results from MIP1, you would use: $ wcgstats -w -aMIP1 -sA MIP1_00317382_18863_1-- Linux Fedora 716 Server Aborted 9/8/20 03:50:00 9/8/20 05:36:35 0.00 0.0 / 0.0Finally, to answer your question, you would need another filter - like some short Perl code - to find the answer to your question. I'll have to give it some thought.  PS. Lots of options available!  Without options, the program will show basic statistics (as seen on ”My Contribution” page), its original intention. $ wcgstats 2020-09-08 12:06:02 166:072:12:44:38 1,101 550,513,054 360 2,282,174 137 330:055:22:02:31 412 816,409,068 247 2,720,835 155 |
||
|
|
Aurum
Master Cruncher The Great Basin Joined: Dec 24, 2017 Post Count: 2384 Status: Offline Project Badges:
|
Adri, Thanks for considering it. PERL was made for such a task. Sadly I forget all the PERL I knew two decades ago :-)
----------------------------------------I can't see a way to tell how many ARP WUs I've completed, but it's a fair amount. I think your WCGresults script only returns my own results. Still that's a start. I'll give it a try and strong arm it in excel. ...KRI please cancel all shadow-banning |
||
|
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2104 Status: Offline Project Badges:
|
adri, Would it be possible to use your script https://a3a3.home.xs4all.nl/wcg/wcgresults to extract all ARP WUs with 3 or more Valids awarded??? After doing the shopping for our daily needs, I'm coming up with these thoughts: If you have a certain number of results that exceeds 15, more than fits a Results Status page, you need to use pagenumbers (option -p of wcgstats). Let's say you have found the number of Results Status pages using wcgstats -w -aARP1 -l1 and now you want to find out the number of Valids per result that's more than two (--I haven't got enough ARP1's in my results, so I'll be using OPN1 instead--): $ wcgstats -w -aOPN1 -Qff -l1 Pages: 39(The number we've found here is 39.) Then you can use a loop (--plus-- you must use the option -A of wcgstats to prevent interference with the string " Valid ", a string that doesn't cause confusion with 'Pending Validation'): $ for p in `seq 1 39`;do wcgstats -A -aOPN1 -wQ -p$p -P | perl -w00ne '@r = split(/ Valid /); print "$#r:\n$_" if $#r >= 3'; done(The seagreen-coloured workunit-names are mine.)So now the interesting part: as soon as you have found the exact number of Results Status pages, you can use the loop command above, using "ARP1" instead of "OPN1", of course.  |
||
|
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2104 Status: Offline Project Badges:
|
Adri, Thanks for considering it. PERL was made for such a task. Sadly I forget all the PERL I knew two decades ago :-) Yes, you have to keep up the knowledge, just as spoken and written language.I can't see a way to tell how many ARP WUs I've completed, but it's a fair amount. You would need to start using something like wcgresults to log results to a (log)file, then you could count them. Here's my way: each hour I'm logging all my results that went through the validator, using crontab with this entry in my crontab: $ crontab -l | grep wcgresults(Here, 'xx' is the number of minutes after the hour.) Then e.g. use wcglog to count the number of ARP1s: $ wcglog -1 -e ^arp1 I think your WCGresults script only returns my own results. That's right. My wcgresults script only returns your own results. (However, you could add other members' names if you know their verification codes.)That said, you could use the free LibreOffice Spreadsheet Application oocalc to view the logfile, too.   Also, let's not forget that it goes without saying: wcgstats only works on what's currently available on the WCG website, i.e. if your results disappear from the Results Status pages, then they have gone forever.  [Edit 1 times, last edit by adriverhoef at Sep 8, 2020 5:45:06 PM] |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
I can't see a way to tell how many ARP WUs I've completed, but it's a fair amount. Have a look at https://www.worldcommunitygrid.org/ms/viewMyMemberPage.do |
||
|
|
|