Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 34
Posts: 34   Pages: 4   [ Previous Page | 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 24851 times and has 33 replies Next Thread
anhhai
Veteran Cruncher
Joined: Mar 22, 2005
Post Count: 839
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Estimated runtime on ZIKA totally off

From what I have seen and heard, the admins try to make all of the wu fir this project roughly the same size. So your 55 min ones will take as long as your 16 min ones
----------------------------------------

[May 20, 2016 4:52:38 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Estimated runtime on ZIKA totally off

The effect of the feedback loop going into new work task headers (and the smarts that seippel posted about which could take weeks to months before it has enough data to be able to build more even TTC projecting tasks)... an original from launch day at 17:39 minutes, another 2:43:38 hours, some of the next day at 9:28 hours and back to 1:01 hours later on. Looks like the system is fast responding.

As of 8:00 AM UTC there were 53K returns for the day (front page zika slide), so we could easily see upwards of 125K by the end of the day. And this is only full day 2... not exactly a slow starting project. ;o)

World Community Grid 7.05 zika ZIKA_000000039_x4wtg_HCV_NS5B_5muts_wRNA_0173_1 - (-) 0.00 0.000 00:17:39 18-May-2016 7:31:03 PM 08d,09:47:53 Ready to start 0.00 MB 0.00 MB
World Community Grid 7.05 zika ZIKA_000000054_x4wtg_HCV_NS5B_5muts_wRNA_0165_1 - (-) 0.00 0.000 02:43:38 18-May-2016 7:48:23 PM 08d,10:05:12 Ready to start 0.00 MB 0.00 MB
World Community Grid 7.05 zika ZIKA_000000161_x4wtg_HCV_NS5B_5muts_wRNA_0169_1 - (-) 0.00 0.000 09:28:13 19-May-2016 6:53:44 AM 08d,21:10:34 Ready to start 0.00 MB 0.00 MB
World Community Grid 7.05 zika ZIKA_000000197_x4wtg_HCV_NS5B_5muts_wRNA_0181_0 - (-) 0.00 0.000 09:28:13 19-May-2016 8:08:53 AM 08d,22:25:43 Ready to start 0.00 MB 0.00 MB
World Community Grid 7.05 zika ZIKA_000000198_x4wtg_HCV_NS5B_5muts_wRNA_0126_1 - (-) 0.00 0.000 09:28:13 19-May-2016 8:12:01 AM 08d,22:28:51 Ready to start 0.00 MB 0.00 MB Desked-03 3113135 (Home)
World Community Grid 7.05 zika ZIKA_000000201_x4wtg_HCV_NS5B_5muts_wRNA_0232_1 - (-) 0.00 0.000 09:28:13 19-May-2016 8:16:17 AM 08d,22:33:07 Ready to start 0.00 MB 0.00 MB Desked-03 3113135 (Home)
World Community Grid 7.05 zika ZIKA_000000204_x4wtg_HCV_NS5B_5muts_wRNA_0057_1 - (-) 0.00 0.000 09:28:13 19-May-2016 8:28:25 AM 08d,22:45:15 Ready to start 0.00 MB 0.00 MB Desked-03 3113135 (Home)
World Community Grid 7.05 zika ZIKA_000000213_x4wtg_HCV_NS5B_5muts_wRNA_0131_1 - (-) 0.00 0.000 09:28:13 19-May-2016 9:10:57 AM 08d,23:27:47 Ready to start 0.00 MB 0.00 MB
World Community Grid 7.05 zika ZIKA_000000251_x4wtg_HCV_NS5B_5muts_wRNA_0423_1 - (-) 0.00 0.000 01:01:17 19-May-2016 11:09:41 AM 09d,01:26:31 Ready to start 0.00 MB 0.00 MB

edit: This machine is torque down to 3GHz
----------------------------------------
[Edit 1 times, last edit by Former Member at May 20, 2016 7:57:38 AM]
[May 20, 2016 7:52:18 AM]   Link   Report threatening or abusive post: please login first  Go to top 
RTorpey
Advanced Cruncher
Joined: Aug 24, 2005
Post Count: 67
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Estimated runtime on ZIKA totally off

I'm glad I only had a 1 day buffer of WU's - the original estimate of 10-17min is now taking 2-6hrs. That changes the 1 day buffer to a 12 day buffer at best. Now everything is running at high priority for WU's that are still 8 days away from their due date - which some will not make :-(((
[May 21, 2016 1:48:20 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Estimated runtime on ZIKA totally off

The cap is hard 35 units per core in progress on a client. If all were 6 hours, 35 computes to completing in 8.75 days. Just let it run and be happy.
[May 21, 2016 1:57:01 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Estimated runtime on ZIKA totally off

I'm glad I only had a 1 day buffer of WU's - the original estimate of 10-17min is now taking 2-6hrs. That changes the 1 day buffer to a 12 day buffer at best. Now everything is running at high priority ...
Hehe, been there, done that blushing
I've learnt to ramp up a new project quite slowly with that in mind. I still earned a bronze badge out of that initial fill, though.
[May 21, 2016 1:59:18 PM]   Link   Report threatening or abusive post: please login first  Go to top 
littlepeaks
Veteran Cruncher
USA
Joined: Apr 28, 2007
Post Count: 748
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Estimated runtime on ZIKA totally off

I have a question about run time calculations -- this may have already been answered in another thread -- if so, sorry.

When I first started running OpenZika, my PC downloaded "oodles" of WUs, because it estimated the runtimes as 15 min. each. When I start running a WU, the estimated runtime goes down to about 1:36 minutes, then slowly starts increasing to a certain point, then slowly starts going down again. On my PC, most WUs take about 2:50 hours.

Meanwhile, the progress column seems to be increasing in a fairly linear manner. How does the progress column compute the percent of WU completed? Couldn't the progress algorithm be used to compute a more accurate runtime remaining value for the WU, since it know what percent has been done, and how much time it took to reach that point?

Littlepeaks is curious.
[May 21, 2016 4:51:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
deltavee
Ace Cruncher
Texas Hill Country
Joined: Nov 17, 2004
Post Count: 4892
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Estimated runtime on ZIKA totally off

Meanwhile, the progress column seems to be increasing in a fairly linear manner. How does the progress column compute the percent of WU completed? Couldn't the progress algorithm be used to compute a more accurate runtime remaining value for the WU, since it know what percent has been done, and how much time it took to reach that point?

Littlepeaks is curious.


Use <fraction_done_exact/> in your app_config.xml file to get a precise remaining value of runtime based on the percent complete.
[May 21, 2016 5:00:08 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Estimated runtime on ZIKA totally off

1) The task is made up of many tasks combined [a variable number], each with different runtime. As the project progresses it is hoped to learn about duration patterns, so the sum mix of the tasks combined can be achieved to get a more even end-runtime from one assignment to the next.

2) Because these internal task subs vary in runtime duration, the progress counter just adapts to whatever sub is running to extrapolate what an end time might be... so it goes up and down.

3) To get better progress projection, though not absolute, use the <fraction_done_exact/> tag in an app_config.xml. This one works purely on total time computed and the indicated percent progress and extrapolates from there. You will see it still going up, or down, depending on how the original total time to completion was set for the task.

Over here there's a bunch queued with 9 hours on them, but they do 4-5 hours. Sure prevents over-buffering :D
----------------------------------------
[Edit 1 times, last edit by SekeRob* at May 21, 2016 5:04:06 PM]
[May 21, 2016 5:02:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1993
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Estimated runtime on ZIKA totally off

Well, now exactly what I predicted starts happening. FAH2 WUs downloaded after the first long batches of HST WUs are starting to time out/being labeled as "too late" due to their short 3 day deadline and those HST WUs that came in with 12-15 minutes end up actually running for up to 12h... sad

Ralf
----------------------------------------

[May 21, 2016 5:58:14 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Estimated runtime on ZIKA totally off

Has anybody seen HST jobs with 12-15 minutes TTC on arrival?

The average ZIKA project runtime indicates 2.3 hours. I've yet to see a single one going over 5.5 on completion.
----------------------------------------
[Edit 1 times, last edit by SekeRob* at May 21, 2016 6:15:42 PM]
[May 21, 2016 6:14:42 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 34   Pages: 4   [ Previous Page | 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread