Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 10
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 931 times and has 9 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Setting project priority

At present, setting which projects you would like work units from is very rudimentary. Would it be possible to create a more useful priority scheme on this web site, or is BOINC incapable of coping with anything more complex than the current setup? It would be very useful to be able to rank each project so as to request WUs from one project first, from another if that one isn't available, etc.
[Feb 25, 2008 2:25:45 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Setting project priority

Hello Kremmen,
That is definitely not the way BOINC is currently set up. After we switch over to all-BOINC and upgrade our DB version, knreed would have to write some programs for the scheduler (WCG-specific) and make some additions to the website. We already have a long wish list for him to try to put into the new server software, as and when time becomes available.

I don't think this will be done anytime soon

Lawrence
[Feb 25, 2008 2:58:00 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Setting project priority

When the projects are working properly, the current system is adequate. But, let's say I'd like to do a project X if possible. Currently there are 3 choices:
1) Participate in X only, in which case my machines will sit idle for periods of time when project X WUs aren't available.
2) Participate in X and other projects, in which case I'll get random WUs that often won't be project X.
3) Participate in X with "If there is no work available for my computer for the projects I have selected above, please send me work from another project" checked, in which case I'll get some HCC WUs, which will run to completion but crash out with segmentation violations once complete.

There is currently no way to exclude a faulty project to avoid this situation. More generally, a priority setting would be better than a yes/no checkbox anyhow.
[Feb 25, 2008 3:32:25 AM]   Link   Report threatening or abusive post: please login first  Go to top 
retsof
Former Community Advisor
USA
Joined: Jul 31, 2005
Post Count: 6824
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Setting project priority

1) Participate in X only, in which case my machines will sit idle for periods of time when project X WUs aren't available.
This is a problem with AC@H, which only has 820 WU every once in awhile, plus error reruns. It works well with two projects (AC@H plus something else), to keep it busy in the meantime.

To run one project, I can fill the queue with three days worth of a preferred project and not ask for other projects.

I watch every day or so to make sure it stays full.

There was a recent problem with FAAH, and nothing from any project was getting through, but I had enough work to get me through the bad day without asking for projects other than one I was working on. If it had gone on, I would have.
----------------------------------------
SUPPORT ADVISOR
Work+GPU i7 8700 12threads
School i7 4770 8threads
Default+GPU Ryzen 7 3700X 16threads
Ryzen 7 3800X 16 threads
Ryzen 9 3900X 24threads
Home i7 3540M 4threads50%
----------------------------------------
[Edit 1 times, last edit by retsof at Feb 25, 2008 4:04:49 AM]
[Feb 25, 2008 4:03:59 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Setting project priority

Simply put, it has been requested before, to add e.g. a secondary set of projects if the prime is not available or add percentages e.g. treat the 5 WCG projects as separate with their own weights or the priority order. If WCG even wants to entertain the idea I do not recollect of ever hearing. Certainly I do not remember any BOINC project that has a choice of jobs to permit weighting /prioritizing sub-projects. There are a few around so think the whole mechanics on the server side was never developed by Berkeley and with WCG in transition from a severely aging DB7.2 (until UD agent is phased out entirely), the plate is laden, and that I'm sure some experience that observation as a brush off, but is reality.

With 4 profiles available it is certainly possible to steer jobs to the machines that are best at a particular type. E.g. My P4 is not very good at HPF2 (oh so slow), so it ain't getting them and sits in it's own in 'school'.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Feb 25, 2008 7:04:13 AM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Setting project priority

Kremmen,

The currently scheduler for BOINC has some limitations based on how it was originally written. At the BOINC workshop in 2007 there was a lot of discussion about this and there was a design sketched out on how to replace the simpler version of the scheduler with a more advanced host-workunit matching mechanism.

The current mechanism for sending work to a computer works (simplified explanation follows) by starting at a random workunit and then checks to see if the computers meets the requirements and if the user is signed up for the app. If the answer is use, the workunit is sent to the user. If not, then go on to the next workunit. This process repeats until the work request is satisfied.

David Anderson is looking at starting to implement these changes. The first version of this will replicate the existing functionality within the existing framework.

The new framework will again start with a random workunit but instead of making a binary decision, it will assign a score to the result for its fitness for execution on the computer. It will then examine the rest of the workunits in the memory cache and also assign them a score. The workunits with the highest score will then be assigned to the computer.

Once this framework is in place, it opens up the ability to look at adding new code to do as you suggest (assign a weight to our applications within a project) or new features such as allowing users to specify the amount of data to download at most X MB of data per week (the new framework would then give a bias to workunits with high cpu time/data ratios as the limit is approached).

These changes are going to take awhile to be implemented. However, progress is being made in this area.

Kevin
----------------------------------------
[Edit 1 times, last edit by knreed at Feb 25, 2008 3:39:43 PM]
[Feb 25, 2008 3:32:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Setting project priority

The new framework will again start with a random workunit but instead of making a binary decision, it will assign a score to the result for its fitness for execution on the computer. It will then examine the rest of the workunits in the memory cache and also assign them a score. The workunits with the highest score will then be assigned to the computer.


Sounds nifty. That framework would allow for much more functionality than I was after.

Another thing that would be useful is an easy way to override some of the unnecessary restrictions that are in place at times. eg. The scheduler refused to give a machine of mine an AC@H WU because it wanted it to have 548MB RAM. Or some such silly number. The machine has 512MB, which is more than adequate for Linux box with no graphics. (and 1GB of swap space which is more than enough for the 500MB+ peak process size that AC@H goes to for the last 10 seconds of its run.)

If you were scoring WUs, that would make it easy to factor in resource utilisation in a fuzzy way, rather than the current, and at times totally incorrect, yes/no way.
[Feb 26, 2008 5:20:01 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Setting project priority

To run one project, I can fill the queue with three days worth of a preferred project and not ask for other projects.


Good point. Some of my machines might be off for days/weeks, so I've tended not to queue work up, so that I don't have to abort WUs or leave them never completed. However, for the machines that will be on all the time, I should do exactly as you suggest.
[Feb 26, 2008 6:58:35 AM]   Link   Report threatening or abusive post: please login first  Go to top 
retsof
Former Community Advisor
USA
Joined: Jul 31, 2005
Post Count: 6824
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Setting project priority

I have received AC@H on my smallest 512Mb machine. HOWEVER, the swap file(virtual memory) is 4 times larger at 2 Gb, which must allow it to get that project.

Even then, the machine cannot even be used for anything else, like websurfing, when AC@H is running. It doesn't matter. That one is primarily a cruncher.
----------------------------------------
SUPPORT ADVISOR
Work+GPU i7 8700 12threads
School i7 4770 8threads
Default+GPU Ryzen 7 3700X 16threads
Ryzen 7 3800X 16 threads
Ryzen 9 3900X 24threads
Home i7 3540M 4threads50%
----------------------------------------
[Edit 1 times, last edit by retsof at Feb 26, 2008 1:50:08 PM]
[Feb 26, 2008 1:49:44 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Setting project priority

Another thing that would be useful is an easy way to override some of the unnecessary restrictions that are in place at times. eg. The scheduler refused to give a machine of mine an AC@H WU because it wanted it to have 548MB RAM. Or some such silly number. The machine has 512MB, which is more than adequate for Linux box with no graphics. (and 1GB of swap space which is more than enough for the 500MB+ peak process size that AC@H goes to for the last 10 seconds of its run.)


The 'hard' limit for RAM for AfricanClimate@Home is 500MB. Make sure that you have set your profile so that it allows 100% of your RAM to be used if you want the 512MB computer to be able to get work from the project.
[Feb 26, 2008 4:16:20 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread