Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 27
Posts: 27   Pages: 3   [ 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2489 times and has 26 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Long WU still occuring

I had hoped that the long WU were out of the system. It is such a risk to have these jobs when the go to my slower systems. Then I had to wait another 1.5 days to have the WU validated too. smile

faah4440_ 001535_ MC_ xMut_ md03230_ 01_ 0-- Valid 06/10/08 18:46:09 08/10/08 15:50:29 31.65 259.1 / 229.0
[Oct 9, 2008 3:10:16 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Long WU still occuring

There will always be "longer" jobs in an experiment for the toughest compounds.

That you had to wait 1.5 days for a whomp in credit I don't see. from 15:50 yesterday to now, UTC is not 24 hours. If you had to wait, then either there was a second job sent out after yours returned for verification, or an initial distribution of 2 was pushed out indicating that your client is up for "board" review wink

[Added: Today's noon chart, not published, shows 9.5 hours as average run time, meaning that the target 7-8 hours was exceeded somewhat. We'll survive.]
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
----------------------------------------
[Edit 1 times, last edit by Sekerob at Oct 9, 2008 3:37:22 PM]
[Oct 9, 2008 3:33:17 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Long WU still occuring

I just needed to take my own medicine. Patience
[Oct 9, 2008 5:49:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Crystal Pellet
Veteran Cruncher
Joined: May 21, 2008
Post Count: 1323
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Long WU still occuring

I just needed to take my own medicine. Patience


Hey Astrolab,

If you forgot it, take it on time.
If you don't forgot it, double the recommended dose wink
[Oct 10, 2008 10:22:49 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Papa3
Senior Cruncher
Joined: Apr 23, 2006
Post Count: 360
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Long WU still occuring

Added: Today's noon chart, not published, shows 9.5 hours as average run time, meaning that the target 7-8 hours was exceeded somewhat. We'll survive.

The target should be more like 24 hours. The network traffic is about the same per job, no matter how long the job is. With the 10-day processing timeframe, an 8-hour granularity is way too fine. It generates unnecessary network traffic, which could easily be cut by 2/3 simply by using a 24-hour target length instead.
[Oct 13, 2008 7:02:10 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Long WU still occuring

The problem with these variable length jobs is that if WCG would raise the average to 3 times, one would do it in 9 hours instead of 3 and the other part time computer would take 72 hours instead of 24, getting these into serious deadline stress. With the return times in mind, the batches need to continue to complete and flow back to the scientists, it would lock out many volunteers with lesser resource and that would be counter to the objective of have as many volunteers able to contribute to FAAH, or any other WCG project.

That said, there are developments underway to be able to cut work to size in a more dynamic fashion, meaning that powerful PCs get heavier jobs and not so powerful less hefty version so all can do it like the RICE project in e.g. 8 hours.

Present deadlines for all projects is 12 days btw. HPF2 is the exception with 20 days.

cheers
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Oct 13, 2008 7:19:06 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Long WU still occuring

I didn't mean to start all this confusion about run times. I just thought that after the issues that FA@H had this summer, that all the jobs were able to run about 8 hours. Unfortunately there is more flexibility in the run times for FA@H than the other projects. Now I know that FA@H needs some longer run times which cannot be unexpected. That is all I was looking for.
[Oct 14, 2008 2:31:51 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Papa3
Senior Cruncher
Joined: Apr 23, 2006
Post Count: 360
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Long WU still occuring

The problem with these variable length jobs is that if WCG would raise the average to 3 times, one would do it in 9 hours instead of 3 and the other part time computer would take 72 hours instead of 24... Present deadlines for all projects is 12 days btw.
A 72 hour processing time would be accounted for in the estimated time to completion (i.e., 72 hours from now). Therefore, the part-time computer's job download algorithm would only download the appropriate number of jobs for a 12 day window (3 jobs in this case). So the part-time computer would run 3 or 4 jobs in the 12 days, while the 24/7 system would download and run about 31 jobs in the same 12 days. In both cases, network traffic will be cut by 2/3. cool Thus, I do not see how your scenario results in any actual harm. I do see, however, a benefit - namely, the 2/3 reduction in network traffic. biggrin
[Oct 17, 2008 8:04:39 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Long WU still occuring

The point is not the download sizes or the client adjusting to the power available. What I mean is that a client that from the outset takes 72 hours of CPU time and is only on for say 6 hours a day and running at 60% throttle will never ever be able to complete the job in time, not even in 12 days. Are you going to tell these volunteers: "No you can't help WCG?".
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Oct 17, 2008 8:31:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Papa3
Senior Cruncher
Joined: Apr 23, 2006
Post Count: 360
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Long WU still occuring

The point is not the download sizes or the client adjusting to the power available. What I mean is that a client that from the outset takes 72 hours of CPU time and is only on for say 6 hours a day and running at 60% throttle will never ever be able to complete the job in time, not even in 12 days. Are you going to tell these volunteers: "No you can't help WCG?".

Please note that I have consistently and specifically proposed that the job length be set at 12 to 24 hours (as opposed to 8 hours currently). The upper bound on job length is, rather obviously, imposed by the need to avoid deadline difficulties. Assuming a 24-hour job length and a 12-day deadline window, the client needs to crunch for an average of only 2 hours per 24-hour period.
[Oct 22, 2008 10:40:55 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 27   Pages: 3   [ 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread