Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 
World Community Grid Forums
  Category: Active Research
  Forum: Africa Rainfall Project
  Thread: Work Available

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 3593
Posts: 3593   Pages: 360   [ Previous Page | 142 143 144 145 146 147 148 149 150 151 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 5810178 times and has 3592 replies Next Thread
spRocket
Senior Cruncher
Joined: Mar 25, 2020
Post Count: 280
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Currently I have an 096 priority job and an 097 non-priority on my main cruncher, with an 071 on-deck but deep in the queue. One of my other crunchers also has an 096 on priority, and there's a 100 on one laptop and an 095 on the other.

The 095 has been absolutely slogging. More than once, I've seen the estimated time extend past the deadline, only to get reeled in later. Currently, the estimate is 4.6 hours on a 5.9 hour deadline.

EDIT: The 095 finally completed, after 75.98 hours of elapsed time, and came back valid. Talk about a squeaker!
----------------------------------------
[Edit 1 times, last edit by spRocket at Oct 20, 2021 10:17:03 AM]
[Oct 20, 2021 12:10:23 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12594
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
I have a 104 come in 2 hours ago and a 069 last night.

Mike
[Oct 20, 2021 1:37:29 PM]   Link   Report threatening or abusive post: please login first  Go to top 
MJH333
Senior Cruncher
England
Joined: Apr 3, 2021
Post Count: 301
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Mike,
097 is now priority.

Cheers,
Mark
[Oct 21, 2021 7:35:29 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12594
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Thanks, Mark.

Hopefully we will get an update from Kevin before I do my next update at the weekend.

Mike
[Oct 21, 2021 1:35:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Latest stats

Average generation: 98.4
Pace (average time to complete a generation): 4.00 (14-day average)

first_indexed       generation num_units_currently_on_generation num_units_completed_last_day 
------------------- ---------- --------------------------------- ---------------------------- 
2019-10-01 22:26:53 000                                                                       
2019-10-30 18:58:54 001                                                                       
2019-12-08 11:56:25 002                                                                       
2020-01-12 02:02:34 003                                                                       
2020-02-08 03:43:00 004                                                                       
2020-02-24 06:27:42 005                                                                       
2020-03-09 17:38:25 006                                                                       
2020-03-17 08:44:19 007                                                                       
2020-03-23 20:52:24 008                                                                       
2020-04-01 14:39:46 009                                                                       
2020-04-12 08:29:32 010                                                                       
2020-04-21 02:41:36 011                                                                       
2020-05-02 03:16:28 012                                                                       
2020-05-10 13:29:40 013                                                                       
2020-05-22 10:46:51 014                                                                       
2020-06-02 21:07:48 015                                                                       
2020-06-20 20:53:08 016                                          3                            
2020-07-01 12:31:12 017        3                                 1                            
2020-07-09 18:39:23 018        1                                 1                            
2020-07-18 16:08:31 019        1                                                              
2020-07-26 16:32:08 020                                                                       
2020-08-08 15:15:22 021                                                                       
2020-08-19 00:49:10 022                                                                       
2020-08-24 07:02:09 023                                                                       
2020-08-30 05:56:33 024                                          1                            
2020-09-04 11:35:58 025        1                                                              
2020-09-09 17:27:07 026                                                                       
2020-09-15 06:25:11 027                                                                       
2020-09-20 10:01:14 028                                                                       
2020-09-25 22:07:49 029                                                                       
2020-10-02 07:08:22 030                                                                       
2020-10-07 17:55:57 031                                                                       
2020-10-14 16:25:19 032                                                                       
2020-10-18 20:05:40 033                                                                       
2020-10-25 15:34:22 034                                                                       
2020-10-31 22:55:26 035                                                                       
2020-11-04 06:29:28 036                                                                       
2020-11-12 06:33:47 037                                                                       
2020-11-17 09:21:26 038                                                                       
2020-11-24 13:47:28 039                                                                       
2020-11-30 07:44:02 040                                                                       
2020-12-07 20:20:00 041                                                                       
2020-12-13 18:26:56 042                                                                       
2020-12-20 00:33:11 043                                                                       
2020-12-25 22:27:11 044                                                                       
2021-01-01 07:57:34 045                                                                       
2021-01-07 18:08:33 046                                                                       
2021-01-15 02:41:00 047                                                                       
2021-01-22 20:25:40 048                                                                       
2021-01-28 10:53:04 049                                                                       
2021-02-03 14:32:54 050                                                                       
2021-02-09 03:20:45 051                                                                       
2021-02-16 14:14:47 052                                                                       
2021-02-22 01:22:20 053                                                                       
2021-02-28 10:29:30 054                                                                       
2021-03-06 18:23:14 055                                                                       
2021-03-12 10:16:29 056                                                                       
2021-03-17 08:30:15 057                                                                       
2021-03-23 06:08:46 058                                                                       
2021-03-29 22:39:10 059                                                                       
2021-04-05 05:01:38 060                                                                       
2021-04-10 21:09:07 061                                                                       
2021-04-16 23:20:59 062                                          1                            
2021-04-22 07:50:06 063        1                                                              
2021-04-28 23:02:38 064                                                                       
2021-05-04 04:45:55 065        1                                 1                            
2021-05-09 14:11:18 066        1                                                              
2021-05-16 14:55:41 067        1                                                              
2021-05-23 15:02:08 068        1                                 1                            
2021-05-26 06:43:43 069        1                                 3                            
2021-05-29 18:38:55 070        3                                 2                            
2021-06-03 15:46:15 071        4                                 3                            
2021-06-11 23:13:21 072        2                                 3                            
2021-06-15 11:54:58 073        5                                                              
2021-06-22 00:30:34 074        3                                 2                            
2021-06-27 11:56:43 075        1                                 5                            
2021-07-02 15:06:05 076        8                                 2                            
2021-07-08 20:49:12 077        6                                 6                            
2021-07-14 07:30:06 078        8                                 2                            
2021-07-18 14:21:26 079        3                                 1                            
2021-07-20 23:37:16 080        4                                 4                            
2021-07-23 21:00:51 081        9                                 2                            
2021-07-27 02:27:09 082        8                                 3                            
2021-07-29 02:04:50 083        10                                2                            
2021-07-30 14:32:48 084        11                                3                            
2021-08-03 02:15:23 085        4                                 7                            
2021-08-05 08:06:31 086        13                                7                            
2021-08-08 05:34:18 087        11                                4                            
2021-08-11 02:09:16 088        24                                11                           
2021-08-14 02:27:13 089        49                                5                            
2021-08-17 22:32:03 090        32                                6                            
2021-08-25 18:05:01 091        21                                7                            
2021-08-30 12:27:03 092        20                                18                           
2021-09-01 12:32:48 093        78                                56                           
2021-09-03 19:10:00 094        232                               181                          
2021-09-06 08:58:44 095        938                               661                          
2021-09-14 22:52:49 096        4176                              1771                         
2021-09-21 22:29:20 097        7708                              1765                         
2021-09-24 05:51:32 098        6308                              1438                         
2021-10-04 04:47:24 099        5432                              1191                         
2021-10-05 15:37:15 100        4188                              1048                         
2021-10-07 22:43:22 101        3082                              676                          
2021-10-10 14:42:51 102        1857                              348                          
2021-10-13 09:24:05 103        923                               175                          
2021-10-18 00:46:24 104        392                               24                           
2021-10-20 21:01:06 105        24

[Oct 21, 2021 7:22:42 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
One item of note - the extreme laggards were not moving fast enough to be able to catch up before the "average generation" reaches end of project. This would cause a long wind-down at the end of the project and a delay in the scientists being able to do their final analysis. In order to get them moving faster we are now sending out 3 copies of those extreme laggards (defined as 25 generations behind the lead generation).

You can see the impact of this in the data above as it shows that the 6 units furthest behind units all advanced a generation in the past 24 hours.

At a larger scale you can see the overall impact of the three strategies (sending extreme laggards to 3 reliable hosts, sending regular laggards to 2 reliable hosts and then treating the rest as normal) in the following data which is based on data from units completed in the past 48 hours. The avg_hrs_to_complete refers to the time from when we loaded the unit and made it available to be processed until the time that it was validated and the next generation was created.

num_completed avg_hrs_to_complete type        
------------- ------------------- ----------- 
   71         25.1                Extreme     
 3709         46.7                Regular 
14727         98.3                Normal


This increase of 0.2% in the runtime needed by the project is significantly helping catch up those units that are furthest behind.
[Oct 21, 2021 7:46:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12594
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Thank you, Kevin.

13 days have passed since the last report. In that time, the 6 hindmost laggards has moved on 8 generations to generation 017, whereas the last of the main batches has moved on 6 generations. At those rates, catch-up will occur in about 6 weeks.

119,588 units have been validated in the last 13 days (9,199.1 per day), compared with 237,872 results returned, so we have 1,304 results awaiting validation.

097 is the latest generation identified as labelled 'priority'. I will base this response on that. If anyone knows of a later batch please advise and I will adjust my figures.

37.6% of the units are in the priority generations.

There are now 3,013,178 units to be crunched to finish the project. The average number of results returned over the last 10 days is up significantly to 18,422.9 per day, so my target for completion is now calculated as 12 September 2022. This assumes no invalids or errors are included in those returns. I suspect we are unlikely to see the project finish much before the end of 2022.

Mike
[Oct 22, 2021 12:26:46 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Work Available
Kevin,

Can you assign the extreme laggards to the fastest returning machines (mine isn't the fastest I'm sure) or a specific machine. I run 64 concurrently and they all finish within about 18 hours (boinc client has them estimated at 17:23), give or take an hour or so. I would be willing to dedicate the machine to them. I count about 51 WUs identified as extreme laggards so they all could run concurrently. Machine runs 24x7.
[Oct 22, 2021 2:56:03 AM]   Link   Report threatening or abusive post: please login first  Go to top 
MJH333
Senior Cruncher
England
Joined: Apr 3, 2021
Post Count: 301
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Kevin,
If you wished to take up entity's suggestion of having dedicated machines, I'd be happy to dedicate my PCs which together run 30 ARP concurrently 24/7.
Cheers,
Mark
[Oct 22, 2021 5:57:27 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 1298
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Thank you Kevin and Mike for the data and stats. It is great to see the small steps of progress we are making. I really like the plan you came up with for the extreme laggards. It is great that you can actually see it working.
[Oct 22, 2021 7:08:52 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 3593   Pages: 360   [ Previous Page | 142 143 144 145 146 147 148 149 150 151 | Next Page ]
[ Jump to Last Post ]
Post new Thread