Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 10
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1686 times and has 9 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Project Priority Selection

I apologize if this has been posted before in here but I did a search and didn't come up with anything.

A suggestion I have for down the road is a "Project Priority Selection". Currently we have the option of selecting one, multiple, or all projects to run. However, it's a crap shoot on exactly what we'll get out of those selections at the time of download. But say I only want to work on RICE and DDDT...but I would rather work on RICE more.

A neat option to have would be a priority system. Something that lets me pick those 2 projects. Rank RICE as priority 1 and DDDT as priority 2 and so on. That way, when it comes time to download more WUs, it will check with RICE first. If it has available WUs then it will download those and continue crunching. However, if RICE is out of WUs at that time, it would then check DDDT for available work....and so on.

This way I could continue to crunch RICE with a backup of DDDT to make sure my computer doesn't sit idle.

Just a thought.
[Jan 21, 2009 6:59:33 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Project Priority Selection

There's an overarching. We volunteer the resources to X or Y project, that goes into a bin, then WCG works the pool to evenly spread the total resources it sets distribution weights. Then the techs juggles those so that some projects sometimes run faster, sometimes slower to get batch A complete, Experiment Y, or to clear a project feeder for an upgrade, technical issues (storage capacity) and what not. When you juggle your preferences it knocks onto everything else, so the distribution is quite dynamic.

What is the benefit of "I want A and B first, then a bit of C, then if nothing of ABC, I want a bit of D and only if those are depleted E and F"? It done something for you personally, but in the whole, nothing much changes.

Anyway, it's been suggested a few times. If it was ever passed to the developers in Berkeley I don't know. There is major work under way in development of the server side and dynamic job sizing, with WCG pretty much the odd one out going from 6 active projects on multiple platforms to maybe 10, so if it added this further complexity and makes it to the developers table it will be 2010, 2011. And picture what logic and load that will put on a server system to check on the flavors wanted and how much of each and see if there is work for each atm. I think it's nice but do not think it easily realizable.

ttyl

[edit] spelling
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
----------------------------------------
[Edit 1 times, last edit by Sekerob at Jan 22, 2009 10:36:10 AM]
[Jan 21, 2009 7:29:59 PM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Priority Selection

Knightro2,
The last time knreed has posted about possible upgrades on the server side is there: Setting project priority

It's not exactly what you (and me too) would like to see but if your motivation is related to the characteristics of the WUs and not to the objectives of the projects there might be interesting improvements. But probably not really soon anyway.

Currently the only choices are
- either you select projects 1 and 2 and you will get a mixture of both
- or you select project 1 and monitor your Boinc client rather closely to see if you need to replace project 1 by project 2 in the related profile
(after unchecking the "if no work is available..." box in both cases).

Cheers. Jean.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Jan 22, 2009 12:54:59 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Project Priority Selection

What is the benefit of "I want A and B first, then a bit of C, then if nothing of ABC, I want a bit of D and only if those are depleted E and F"? It done something for you personally, but in the whole, nothing much changes.



Where I sit at the moment, I've been trying to concentrate on CEP tasks. At the same time I am running on a quad core Vista machine which seems to hate HPF2, and gives frequent errors. So if I could have my druthers, I would like to say 'Give me CEP if there are work units. If not send me something else but not HPF2.' I shudder to think that impression the servers get of my huge number of errors in HPF2!

Until CEP comes back I am asking for everything except HPF2, but that won't work when CEP is available.

I agree that from the point of view of the big picture nothing much changes, but it would be good to help the volunteer maximise his job satisfaction and would tend to encourage volunteers to stay!

Robert
[Jan 22, 2009 12:46:43 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Project Priority Selection

It's always interesting to see the same subjects popping up in multiple threads, simultaneously. http://www.worldcommunitygrid.org/forums/wcg/printpost?post=212257

The everything else except CEP is quickly achieved by ticking all but HPF2 in the device profile and unticking the "if there is no work". I'm using all 4 profiles and assign to devices for best performance.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jan 22, 2009 12:54:44 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Project Priority Selection

Hey rampt,

That's exactly what I'm trying to go for. Pretty much it came to light for me when they slowed down the RICE project. I'm working exclusively on RICE at the moment. But then I started to not get any work because the queues were cleaned out. My whole thing was I could have crunched cancer or AIDS or something a time or 2 until RICE units were available. But I didn't want to select RICE and say AIDS because I would probably get more AIDS WU's than RICE.
----------------------------------------
[Edit 1 times, last edit by Former Member at Jan 22, 2009 2:04:24 PM]
[Jan 22, 2009 2:03:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Priority Selection

One of the things that we will eventually get to is the that for whatever reasons, some computers simply do not run certain projects correctly. Sometimes it is related to something that can be addressed via the science application and sometimes we cannot find a reason that it fails on that computer.

At the same time, BOINC has a mechanism that will limit the number of workunits sent to a computer if that computer returns nothing but error results. However, this applies across all applications.

I want to modify this so that it will look at the application level and if the client returns valid results for application a and b but not c, then as the number error or invalid results for application c increases, then it will be less and less likely that the computer will be assigned work from project c. This will never be a non-zero chance as the computer should periodically be given a workunit from that project to test if something has changed, but this would significantly limit the problems that are being discussed.

There are certainly many members who do look at the workunits being sent to them and how they are running and which ones are failing or are invalid and which ones run correctly. However, there are many more machines that are not monitored and an automated mechanism like this is highly desirable to maximize member contribution.

I saw this knowing that our list of things we need to get done is very very long (Forum Updates, Points Conversion, and a long list of other features) as well as new projects coming.
[Jan 22, 2009 3:01:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
retsof
Former Community Advisor
USA
Joined: Jul 31, 2005
Post Count: 6824
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Priority Selection

If you have more than one computer, you can play with the device profiles....It's not a priority thing, but may help with distribution.

For example ...

computer on "school" run DDD-T and CEP and HCC
computer on "home" run FA@H

It's still a good idea to check "accept work from other projects" in case what you have checked runs out of work.

Every now and then I find a project that is difficult with my slowest computer and causes excessive fan activity at 100%. I just set it to run the ones it likes, and let the others run anything.

In retrospect, it could have been a failing power supply. It was swapped out for a new one last week.
----------------------------------------
SUPPORT ADVISOR
Work+GPU i7 8700 12threads
School i7 4770 8threads
Default+GPU Ryzen 7 3700X 16threads
Ryzen 7 3800X 16 threads
Ryzen 9 3900X 24threads
Home i7 3540M 4threads50%
----------------------------------------
[Edit 1 times, last edit by retsof at Jan 22, 2009 4:09:55 PM]
[Jan 22, 2009 4:07:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Project Priority Selection

If you have more than one computer like retsof then sure you can play around with what computer does what units.

However I only have the one, which is a fairly stable machine only about 6 errors returned since I started crunching. I would like to do equal amount of work for all projects.

But I find when I select all project I alway seem to get loaded up with more of one or two projects and not as many as the others.

How does the scheduler decide who gets what and would it be possible to have a option to receive equal work for all projects.
----------------------------------------
[Edit 4 times, last edit by Former Member at Mar 15, 2009 1:25:32 PM]
[Mar 15, 2009 1:19:47 PM]   Link   Report threatening or abusive post: please login first  Go to top 
retsof
Former Community Advisor
USA
Joined: Jul 31, 2005
Post Count: 6824
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Priority Selection

It's sort of random. There could be a pile of workunits waiting for one project and little for another if it runs out of work over the weekend or something. That happens now and then. There are also some internal project weightings that are set by the techs if they want to push something through a little faster. One may look heavy for a single day, but over time, it should average out if you run all projects.
----------------------------------------
SUPPORT ADVISOR
Work+GPU i7 8700 12threads
School i7 4770 8threads
Default+GPU Ryzen 7 3700X 16threads
Ryzen 7 3800X 16 threads
Ryzen 9 3900X 24threads
Home i7 3540M 4threads50%
----------------------------------------
[Edit 1 times, last edit by retsof at Mar 15, 2009 5:33:43 PM]
[Mar 15, 2009 5:32:22 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread