| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Completed Research
Forum: The Clean Energy Project - Phase 2 Forum
Thread: Initial time to completion estimates and progress % |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 12
|
|
| Author |
|
|
pirogue
Veteran Cruncher USA Joined: Dec 8, 2008 Post Count: 685 Status: Offline Project Badges: 
|
As reported during the Beta, I'm seeing initial time estimates around 4-5 times actual.
----------------------------------------Of the ones I've actually seen just before completion, they seem to be jumping from around 20% to 100%. (also reported during Beta) All of them start with a nearly 6 hour estimate and finished in 1.5ish. This could cause major problems if the time estimates suddenly become reality for someone with a large cache setting. |
||
|
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
The times (number of flops to complete) are currently set manual so as to prevent over-caching! As results are being returned, both the client learns and corrects through the DCF value and the server learns, dynamically adjusting the time estimates based on actuals. Since the run times during beta were from 1.5 to 12 hours, the mean estimate are likely to settle on a much higher value than the times you now see.
----------------------------------------DCF adjusts slowly down and goes up rapidly as a mechanism to prevent overcaching, but if running with 10 days cache it's asking for trouble. There's works for quite some time... no need for hoarding. PS: As I wrote in another thread, I received the first with 16 hour estimates and completing in 1.6. After 10 or so, the estimate has dropped to 13 hours.
WCG
Please help to make the Forums an enjoyable experience for All! |
||
|
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
Errata:
----------------------------------------After 12 validated, my quad receives new results with a forecasted run time of 32,800 seconds and a projection of 8.5 hours run time (DCF 1.1) i.e. the servers are slowly reducing the mean times (fpops in task headers) and the client adapts gradually to prevent excess caching. Tue 29 Jun 2010 11:22:22 CEST World Community Grid Scheduler request completed: got 1 new tasks Tue 29 Jun 2010 11:22:22 CEST World Community Grid [sched_op_debug] Server version 601 Tue 29 Jun 2010 11:22:22 CEST World Community Grid Project requested delay of 11 seconds Tue 29 Jun 2010 11:22:22 CEST World Community Grid [sched_op_debug] estimated total CPU job duration: 32384 seconds Tue 29 Jun 2010 11:22:22 CEST World Community Grid [sched_op_debug] Deferring communication for 11 sec Tue 29 Jun 2010 11:22:22 CEST World Community Grid [sched_op_debug] Reason: requested by project Tue 29 Jun 2010 11:22:24 CEST World Community Grid Started download of E200007_A.15.C11H7N3S.9.zip Tue 29 Jun 2010 11:22:26 CEST World Community Grid Finished download of E200007_A.15.C11H7N3S.9.zip Meantime, the runtimes are slowly creeping up, same as they did in the beta... the further we get into the batch.
WCG
Please help to make the Forums an enjoyable experience for All! |
||
|
|
pirogue
Veteran Cruncher USA Joined: Dec 8, 2008 Post Count: 685 Status: Offline Project Badges:
|
I see the times dropping, but the % still jumps from around 20 to 100. I panicked when I saw 200+ WUs with a 3 day cache.
---------------------------------------- |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
I see the times dropping, but the % still jumps from around 20 to 100. I panicked when I saw 200+ WUs with a 3 day cache. Looks like they checkpoint 16 times... the last couple steps take about an hour each on this Dell laptop... Benchmark results: Number of CPUs: 2 1690 floating point MIPS (Whetstone) per CPU 4814 integer MIPS (Dhrystone) per CPU They were estimating at 10:20:41, with actual times between 3:20:00 and 3:55:00, and the estimates have now dropped to 9:09:15. |
||
|
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
Every job in the task has a single checkpoint, thus 16, but not all jobs take equal time. Think [but not at all sure] armstrdj noted he'd work on smoothing this... it would need a time consideration pro-rata to the number of jobs that have been completed.
----------------------------------------
WCG
Please help to make the Forums an enjoyable experience for All! |
||
|
|
I need a bath
Senior Cruncher USA Joined: Apr 12, 2007 Post Count: 347 Status: Offline Project Badges: 
|
How can you tell when the checkpoints occur? I searched the FAQ but can't figure it out
---------------------------------------- |
||
|
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
Load the FAQ page in my sig and search for Checkpoint Saving.
----------------------------------------
WCG
Please help to make the Forums an enjoyable experience for All! |
||
|
|
I need a bath
Senior Cruncher USA Joined: Apr 12, 2007 Post Count: 347 Status: Offline Project Badges:
|
oh cool! Thanks
---------------------------------------- |
||
|
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
Not yet covered in the FAQ, but with the upcoming 6.10 client you can select a task that had CPU time and click on the left margin properties button. The pop-up info screen will tell when the last checkpoint was taken.
----------------------------------------
WCG
Please help to make the Forums an enjoyable experience for All! |
||
|
|
|