Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 10
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1265 times and has 9 replies Next Thread
cw64
Advanced Cruncher
Joined: Oct 6, 2007
Post Count: 120
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
When is a task not a task?

19/01/2011 10:23:24 World Community Grid Scheduler request completed: got 2 new tasks


This shouldn't be a cause for concern, except that it was not followed by "started downloading...". I have noticed this before so I quickly look to the tranfers tab, and it is empty. I check the task list and 2 new tasks were added at this time.
So how am I getting tasks without downloading them? o.0
----------------------------------------

----------------------------------------
[Edit 2 times, last edit by cw64 at Jan 19, 2011 10:32:41 AM]
[Jan 19, 2011 10:31:29 AM]   Link   Report threatening or abusive post: please login first  Go to top 
sk..
Master Cruncher
http://s17.rimg.info/ccb5d62bd3e856cc0d1df9b0ee2f7f6a.gif
Joined: Mar 22, 2007
Post Count: 2324
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: When is a task not a task?

You could have posted a few more message log lines, especially the next lines, oh and Boinc version. I take it the project is DDDT2.

For example,
18/01/2011 10:59:50 World Community Grid Sending scheduler request: To fetch work.
18/01/2011 10:59:50 World Community Grid Requesting new tasks for CPU
18/01/2011 10:59:52 World Community Grid Scheduler request completed: got 1 new tasks
18/01/2011 10:59:54 World Community Grid Started download of ts02_a_g03_a021_to_a030_typeC_a028.prm.gzb
18/01/2011 10:59:54 World Community Grid Started download of ts02_a_g03_a021_to_a030_typeC_a028.rtf.gzb
18/01/2011 10:59:56 World Community Grid Finished download of ts02_a_g03_a021_to_a030_typeC_a028.prm.gzb
18/01/2011 10:59:56 World Community Grid Started download of ts02_a_g03_a021_to_a030_typeC_solv_a028.psf.gzb
18/01/2011 10:59:57 World Community Grid Finished download of ts02_a_g03_a021_to_a030_typeC_a028.rtf.gzb
18/01/2011 10:59:57 World Community Grid Finished download of ts02_a_g03_a021_to_a030_typeC_solv_a028.psf.gzb
18/01/2011 10:59:57 World Community Grid Started download of ts02_a_g03_a021_to_a030_typeC_solv_a028_eq.crd.gzb
18/01/2011 10:59:57 World Community Grid Started download of ts02_a_g03_a021_to_a030_typeC_const_dihe.str.gzb
18/01/2011 10:59:58 World Community Grid Finished download of ts02_a_g03_a021_to_a030_typeC_solv_a028_eq.crd.gzb
18/01/2011 10:59:58 World Community Grid Finished download of ts02_a_g03_a021_to_a030_typeC_const_dihe.str.gzb
18/01/2011 10:59:58 World Community Grid Started download of ts02_a_g03_a021_to_a030_typeC_const_para_ts02_a028_equ.str.gzb
18/01/2011 10:59:58 World Community Grid Started download of ts02_a_g03_a021_to_a030_typeC_solv_chg_b2.prt.gzb
18/01/2011 10:59:59 World Community Grid Finished download of ts02_a_g03_a021_to_a030_typeC_const_para_ts02_a028_equ.str.gzb
18/01/2011 10:59:59 World Community Grid Finished download of ts02_a_g03_a021_to_a030_typeC_solv_chg_b2.prt.gzb
18/01/2011 10:59:59 World Community Grid Started download of ts02_a_g03_a021_to_a030_typeC_par_all22_prot_cmap.inp.gzb
18/01/2011 10:59:59 World Community Grid Started download of ts02_a_g03_a021_to_a030_typeC_top_all22_prot_cmap.inp.gzb
18/01/2011 11:00:01 World Community Grid Finished download of ts02_a_g03_a021_to_a030_typeC_par_all22_prot_cmap.inp.gzb
18/01/2011 11:00:01 World Community Grid Finished download of ts02_a_g03_a021_to_a030_typeC_top_all22_prot_cmap.inp.gzb
18/01/2011 11:00:01 World Community Grid Started download of ts02_a_g03_a021_to_a030_typeC_solv_pert.inp.gzb
18/01/2011 11:00:02 World Community Grid Finished download of ts02_a_g03_a021_to_a030_typeC_solv_pert.inp.gzb
18/01/2011 11:00:02 World Community Grid Starting ts02_a028_sqb002_0
18/01/2011 11:00:02 World Community Grid Starting task ts02_a028_sqb002_0 using dddt2 version 617
----------------------------------------
[Edit 1 times, last edit by skgiven at Jan 19, 2011 10:41:24 AM]
[Jan 19, 2011 10:40:21 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: When is a task not a task?

19/01/2011 10:23:24 World Community Grid Scheduler request completed: got 2 new tasks


This shouldn't be a cause for concern, except that it was not followed by "started downloading...". I have noticed this before so I quickly look to the tranfers tab, and it is empty. I check the task list and 2 new tasks were added at this time.
So how am I getting tasks without downloading them? o.0

By observation, same as with several other sciences, no download is needed if sequential work requests follow each other quickly. A switch is flipped to add another seed from a table of some kind that must be coming along for a task group. So far I've seen 5 tasks maximum depending on one single 16 MB main task file. Could be more but that's what I've seen on my quad.

Of course this hugely reduces bandwidth use... goodoos to the techs to maximize efficiency once again.

edit: requests in plural
----------------------------------------
[Edit 2 times, last edit by Former Member at Jan 19, 2011 11:01:55 AM]
[Jan 19, 2011 10:50:46 AM]   Link   Report threatening or abusive post: please login first  Go to top 
cw64
Advanced Cruncher
Joined: Oct 6, 2007
Post Count: 120
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: When is a task not a task?

19/01/2011 10:23:24 World Community Grid Scheduler request completed: got 2 new tasks


This shouldn't be a cause for concern, except that it was not followed by "started downloading...". I have noticed this before so I quickly look to the tranfers tab, and it is empty. I check the task list and 2 new tasks were added at this time.
So how am I getting tasks without downloading them? o.0

By observation, same as with several other sciences, no download is needed if sequential work requests follow each other quickly. A switch is flipped to add another seed from a table of some kind that must be coming along for a task group. So far I've seen 5 tasks maximum depending on one single 16 MB main task file. Could be more but that's what I've seen on my quad.

Of course this hugely reduces bandwidth use... goodoos to the techs to maximize efficiency once again.

edit: requests in plural


I suspected something along those lines. However it raises a further question. Why don't I get all the tasks for a data set first time every time? Wouldn't it be more bandwidth efficient to send all tasks per data set (or more than one or two at a time at least) to clients requesting work?
----------------------------------------

----------------------------------------
[Edit 2 times, last edit by cw64 at Jan 19, 2011 6:06:33 PM]
[Jan 19, 2011 6:03:54 PM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: When is a task not a task?

What you may be noticing is from Computing for Clean Water. There are two sticky files with each target. Once you download those for the target (ex. target03) then all that is downloaded is the xml for the subsequent workunits. The xml is sent in the scheduler request.

Thanks,
-Uplinger
[Jan 19, 2011 6:12:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: When is a task not a task?

The low weighting in the distributor queue probably prevents that. It's a balance between efficiency and spreading the wealth... give many a chance to snag a few when they happen to be in the hopper.

cool
[Jan 19, 2011 6:13:47 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: When is a task not a task?

So how am I getting tasks without downloading them?
The system has a fallback option where, if you cannot get a WU downloaded directly to you, it gets your email address from the WCG registration and emails the zip file to you then unpacks it into the directory assigned. It is a bit slower than the download, but it expands the distribution options. biggrin
[Jan 19, 2011 7:38:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
cw64
Advanced Cruncher
Joined: Oct 6, 2007
Post Count: 120
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: When is a task not a task?

What you may be noticing is from Computing for Clean Water. There are two sticky files with each target. Once you download those for the target (ex. target03) then all that is downloaded is the xml for the subsequent workunits. The xml is sent in the scheduler request.

Thanks,
-Uplinger


Nope, definitely DDDT2
----------------------------------------

[Jan 19, 2011 7:52:06 PM]   Link   Report threatening or abusive post: please login first  Go to top 
cw64
Advanced Cruncher
Joined: Oct 6, 2007
Post Count: 120
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: When is a task not a task?

The low weighting in the distributor queue probably prevents that. It's a balance between efficiency and spreading the wealth... give many a chance to snag a few when they happen to be in the hopper.

cool


It's the bandwidth that costs right? If (big if) a data set can run 5 tasks and I only get one along with everybody else. That's 5 times the cost of distributing the data when it could have been sent just once.
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by cw64 at Jan 19, 2011 8:03:37 PM]
[Jan 19, 2011 8:02:53 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: When is a task not a task?

Sliding off topic, cost is one part of the equation, and doubt this one is outweighing what I outlined as to why that is. Maybe if DDDT2 goes to full production it is changed but have as yet no indication that it will ever be taken out of active-intermittent state.

--//--
[Jan 19, 2011 8:17:06 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread