| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
| World Community Grid Forums
|
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 34
|
|
| Author |
|
|
Greg_BE
Advanced Cruncher Joined: May 9, 2016 Post Count: 124 Status: Offline Project Badges:
|
What settings and values do I use to restrict WCG to something like 3-4 cores?
Here's what I want to do. I have 16 cores. BOINC manager just uses 1 to control 2 GPU's and currently is running 15 cores of WCG. I have Rosetta, LHC (ATLAS 4 cores) as well. I want all the projects to be divided up as equal as possible. LHC is fixed at 4 cores. That does not change. Rosetta and WCG can split the difference of the other 11 cores, I don't care which way it goes. I have tried to set processor amount to something like 25% (the last boxes on the page) or 4 cores, but LHC seems to ignore that. Maybe I am not doing something right there? Earlier (in a deleted thread) I was talking about a app_config script, but then how do you write the project name since it is not World Community Grid, but mapping cancer markers, etc. ? |
||
|
|
PMH_UK
Veteran Cruncher UK Joined: Apr 26, 2007 Post Count: 786 Status: Offline Project Badges:
|
The app_config.xml file goes in each project's folder and can limit by project and/or sub-project.
----------------------------------------Example for sidock below: <app_config> <app> <name>cmdock-boinc</name> <max_concurrent>1</max_concurrent> </app> <app> <name>cmdock-boinc-zip</name> <max_concurrent>1</max_concurrent> </app> <app> <name>cmdock-boinc-zcp</name> <max_concurrent>1</max_concurrent> </app> <project_max_concurrent>1</project_max_concurrent> </app_config> Paul.
Paul.
|
||
|
|
Acibant
Advanced Cruncher USA Joined: Apr 15, 2020 Post Count: 126 Status: Offline Project Badges:
|
The following is my understanding of the route you could take if you don't want to use the XML option proposed by PMH_UK above. BOINC projects all have similar settings for computing preferences and your client gets the most recent revision from any projects you've attached to the client. There are also project preferences unique to that project. See lists of both here but that page doesn't quite match up with preferences on WCG.
----------------------------------------So you would want your computing preferences set regarding the maximum cores BOINC should use no matter the project. On WCG this is done using the "custom profile" option when viewing one of your Device Profiles and is in the Advanced Options section. But then in per-project settings you'd need to adjust what most projects refer to as "resource share" but which WCG refers to as "project weight". The default is 100 and this scales the CPU time proportionally across however many cores you allocate. Because WCG is a bit of a "meta" project with its own project limits, I would set "resource share" on your other projects and then set all preferences at WCG last including its "project weight". So if you want LHC to get 25% of the time on your cores you can have it use the default of 100 for the share, then Rosetta and WCG should both be set to 150 each. So you see that LHC with 100 is 25% of the overall 400 amongst them all. Finally there is a "switch between tasks" or "switch between applications" as WCG calls it. That determines how often work on one project is suspended to start putting computing time toward the others. So an hour toward LHC, then switch to Rosetta for an hour, then WCG for an hour, and so on until in an eight hour period you have two hours on LHC and three on each of Rosetta and WCG. ![]() |
||
|
|
Greg_BE
Advanced Cruncher Joined: May 9, 2016 Post Count: 124 Status: Offline Project Badges:
|
Well I am familiar with that stuff as well. I've tried to set that, but WCG ignores it.
So I would like to get x cores 100% of the time on WCG and x cores 100% of the time on Rosetta. LHC is fixed at 4 and there is no problem. It's getting LHC to settle down. Rosetta is all ready set via app_config. I can turn that down some more to get that half settled. But WCG wants to grab all 15 cores. It's these fields I am trying to figure out: The number of processors used will be the lesser of the two fields below. On multiprocessors, at most use: [lets say 6] processors On multiprocessors, use: [here i had 25] % of processors And then I save this in Custom. I update via BOINC and it seems these values are not read. |
||
|
|
Greg_BE
Advanced Cruncher Joined: May 9, 2016 Post Count: 124 Status: Offline Project Badges:
|
But this is in the Default profile setting.
Maybe i need to make these in the "Home" setting? |
||
|
|
Greg_BE
Advanced Cruncher Joined: May 9, 2016 Post Count: 124 Status: Offline Project Badges:
|
Yes, you mentioned that before in the last post I made earlier this week.
So your saying for Mapping Cancer I have to do that and repeat that for each project? There is no "General" name to cover all the projects? I guess WCG is like a BOINC agent for the computer. |
||
|
|
Bryn Mawr
Senior Cruncher Joined: Dec 26, 2018 Post Count: 384 Status: Offline Project Badges:
|
Well I am familiar with that stuff as well. I've tried to set that, but WCG ignores it. So I would like to get x cores 100% of the time on WCG and x cores 100% of the time on Rosetta. LHC is fixed at 4 and there is no problem. It's getting LHC to settle down. Rosetta is all ready set via app_config. I can turn that down some more to get that half settled. But WCG wants to grab all 15 cores. It's these fields I am trying to figure out: The number of processors used will be the lesser of the two fields below. On multiprocessors, at most use: [lets say 6] processors On multiprocessors, use: [here i had 25] % of processors And then I save this in Custom. I update via BOINC and it seems these values are not read. The missing element is time. I think the way to go for your requirement is setting the resource share to 100 for each project and it will eventually settle down to giving each project an equal share but that can take weeks (WCG is taking all the cores because it is seen as being behind in getting its share and so it’s playing catch up). One thing you can do to speed up the process is to go into computing options and setting the half life from its default of 10 to 1. This reduces the number of days processing that is taken into account and therefore makes it quicker to reach a balance. The problem with setting the max concurrent in the app config files comes when one of the projects goes quiet (as Rosetta and CPDN are now). Because the other projects have a fixed max they cannot take up the slack and you end up with idle cores. |
||
|
|
Greg_BE
Advanced Cruncher Joined: May 9, 2016 Post Count: 124 Status: Offline Project Badges:
|
Not sure what you mean by half life.
Can you explain more? |
||
|
|
Acibant
Advanced Cruncher USA Joined: Apr 15, 2020 Post Count: 126 Status: Offline Project Badges:
|
Not sure what you mean by half life. It looks like there is an option in the cc_config.xml file that relates to this.Can you explain more? <rec_half_life_days>10.000000</rec_half_life_days>Indeed the default value is 10 and so Bryn Mawr is recommending it be set to 1. The description in the documentation for it is "A project's scheduling priority is determined by its estimated credit in the last X days. Default is 10; set it larger if you run long high-priority jobs." ![]() |
||
|
|
Bryn Mawr
Senior Cruncher Joined: Dec 26, 2018 Post Count: 384 Status: Offline Project Badges:
|
Not sure what you mean by half life. It looks like there is an option in the cc_config.xml file that relates to this.Can you explain more? <rec_half_life_days>10.000000</rec_half_life_days>Indeed the default value is 10 and so Bryn Mawr is recommending it be set to 1. The description in the documentation for it is "A project's scheduling priority is determined by its estimated credit in the last X days. Default is 10; set it larger if you run long high-priority jobs." Thank you, that’s it exactly. Sorry for the delay in coming back but I’m out of range a lot of the time. As well as setting it by editing the cc_config file I believe that you can also change it using the options tab in Boinc Manager but I’m not anywhere near my computers to check the details. |
||
|
|
|