Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
World Community Grid Forums
Category: Support Forum: Suggestions / Feedback Thread: FIghtAids work units seem to dominate? |
No member browsing this thread |
Thread Status: Active Total posts in this thread: 17
|
Author |
|
tekennelly
Cruncher Joined: Oct 10, 2005 Post Count: 45 Status: Offline Project Badges: |
Currently my profile is set up to include all current projects (i.e., Zika, Ebola...). It seems that the FightAids work units always have the shortest deadline and therefore cause work units from other projects to wait.
I currently download 7 days of work. As a work around, after the download completes. I disable "allow new tasks" so that I can get a more even distribution of work from all projects. Of course, the FightAids work units come in with the shortest time so they go into immediate execution. Eventually the FightAids work units complete and other work can begin. So, my question is whether FightAids work units are given appropriate time deadlines in balance with the other projects. |
||
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
It depends on how deep you set your buffer. Rule of thumb... keep your Minimum Buffer to -less- than half of the shortest deadline and keep the MaxAB [Max Additional workBuffer] to zero. With that rule applied, the order will be FIFO, first In First Out. As FAH2 is 4 days [always I think], the setting has to be < 2.0 days or they will most always jump the queue and in your case they will always, since the buffer is greater than 4 days anyhow [If you only set FAH2 with that buffer size, you might even incur "will not finish in time"]
----------------------------------------Remember with a 2 day buffer, the work started is already 2 days old, so you still might see the occasional EDF [Earliest deadline first], when repair job arrive, who's deadline is, except for FAH2, about 2.8 to 3.5 days for production work. Think also the HST1 is always 10 days, so they will hardly get rush treatment. BTW the deadline is predicated on the sequence dependencies. Your result is the immediate base for the next task. With a 4 day deadline and 30 dependent tasks in a sequence it means that getting one final result, number _30 to the scientists could take up to 120 days, for the -ls- type even 160, though by observation it seems to take somewhere from 75 to 110 days. [Edit 1 times, last edit by SekeRob* at Jul 7, 2016 6:01:12 PM] |
||
|
tekennelly
Cruncher Joined: Oct 10, 2005 Post Count: 45 Status: Offline Project Badges: |
Ok. Set buffer to 1.5 days and will monitor. Thanks.
|
||
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
There's another form of domination... whenever having multi-project selection and including FAH2, excluding MCM, hardly anything but FAH2 will come. This is aggravated because FAH2 run 14 hours on my 8 core desktop, UGM not coming at all doing 4 hours if fetched manually and the few OET/Zika not even doing 2, so the contribution ratio is completely out of whack. The old question is still up on going: What's the point of multi-project selection pretty plz?
|
||
|
nanoprobe
Master Cruncher Classified Joined: Aug 29, 2008 Post Count: 2998 Status: Offline Project Badges: |
You can also use an app_confile file to set how many of each task can run at the same time. That will probably not change the amount downloaded of each task but it will help you balance the running tasks for each project.
----------------------------------------
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.
|
||
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
If you forget you end up with a full buffer and idle cores, buffer so full, not even work from backup is being fetched. The solution was/is nice to control CEP2 and other heavies, but WCG broke the priority distribution for this science, no continuous crunching on restricted cores and still ending up with idle resources. 😵
|
||
|
enels
Senior Cruncher Joined: Apr 25, 2008 Post Count: 286 Status: Offline Project Badges: |
The WCG staff have huge levers to prioritize projects. Presumably they are happy with the distribution.
If you are not happy you may do better discriminating between the projects you select. |
||
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
One thing which would
|
||
|
nanoprobe
Master Cruncher Classified Joined: Aug 29, 2008 Post Count: 2998 Status: Offline Project Badges: |
One thing which would +1000
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.
|
||
|
uplinger
Former World Community Grid Tech Joined: May 23, 2005 Post Count: 3952 Status: Offline Project Badges: |
Greetings,
The weights for projects are as follows on the feeder: mcm1 - 41.67% ugm1 - 1.04% oet1 - 28.13% fahb - 10.42% hstb - 1.04% zika - 12.5% (I know this does not add up to 100%, we have beta apps as well as some rounding) So, if you have mcm1 unselected, you may see more from fahb, this is because with shorter tasks from zika and oet1 when someone with that project selected specifically they will pull more results off the feeder at one time. They request 24 hours worth of work, they may pull many results off the feeder. But if they were to try to pull 24 hours for fahb, they may only pull like 4 out of say 40 sitting on the feeder. There is no plan at the moment to limit the number of results per host for FAHB. The reason that cep2 has that option was due to the high IO for those work units. As for our immovable schedule, the schedule changes from time to time. There has been an enhancement that I have been working on to potentially fix the download issues for members. Phase 1 of that was deployed yesterday without any members noticing or having issues. We are about to utilize a beta test to test phase 2 for this enhancement. I will explain more then. These are just enhancements that I was working on, others on our team are working hard on other important tasks as well. Thanks, -Uplinger |
||
|
|