Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 11
Posts: 11   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 3586 times and has 10 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Operating system limits?

Do any of the operating systems have a limit on the number of cores they can use?
[Nov 4, 2017 4:05:08 AM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Operating system limits?

Do any of the operating systems have a limit on the number of cores they can use?

Windows seems to have some limit, depending bit size and whether its home or pro or enterprise. IIRC, Linux had a limit, based on the bit size of the OS. Other than that, BOINC (has/had?) a limit of 200 job slots per client instance. If more are used, no further task can be started until previous job finishes. This ignores memory constraints, physical or serviceable by the OS.

Sometimes clients do not recognize the full core count, so a manual cc_config setting needs to force the hand. That problem seems to often arise above 32 threads. Occasionally see a despair post of a member who's got some monster 48-64-96 thread system, and not getting the client to start more than N jobs, at which point the option <ncpus>N</ncpus> will work for most all cases.
----------------------------------------
[Edit 1 times, last edit by SekeRob* at Nov 4, 2017 8:21:09 AM]
[Nov 4, 2017 8:16:34 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Operating system limits?

BOINC client supports a 1000 WU maximum at which point it receives a message indicating too many runnable tasks to any scheduler request. The 1000 limit is a fuzzy limit. If a client has 999 tasks the scheduler will send enough work to satisfy the request which means the client might have more than 1000 WUs but as long as the number is above 1000, you get the too many runnable tasks message
[Nov 4, 2017 2:48:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Operating system limits?

Yes, that is the caching side, but started jobs is FAIK ltd to 200 and throws an error when a job is started without a free slot in the range 0-199 (a result of a project that not properly clears after completion. Not so long ago we had such a reported issue on these forums, or maybe it was Berkeley's).

Saw this morning a new garbage disposal tag is being implemented. If there is no task on the client related to a specific science app, all related to that app will be removed. Not so sure about being a proponent, particular when work is intermittent AND the one-time parts of a science are big or being on the meter.
[Nov 4, 2017 4:10:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Operating system limits?

...Saw this morning a new garbage disposal tag is being implemented. If there is no task on the client related to a specific science app, all related to that app will be removed. Not so sure about being a proponent, particular when work is intermittent AND the one-time parts of a science are big or being on the meter.

I don't like that idea either. If a project moved to complete status, by all means, clean the no longer needed files. But for people that switch projects a lot, this could be much more unnecessary bandwidth on client and server side. If this could be user configurable, say set the tag to no task associated with project abc for "x" amount of days, then flush the associated files. That way it's up to the user, and leave default to something in the area of 90 days.

Sorry for the off topic.
[Nov 5, 2017 9:43:15 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Stiwi
Advanced Cruncher
Joined: May 19, 2012
Post Count: 75
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Operating system limits?

...Saw this morning a new garbage disposal tag is being implemented. If there is no task on the client related to a specific science app, all related to that app will be removed. Not so sure about being a proponent, particular when work is intermittent AND the one-time parts of a science are big or being on the meter.

I don't like that idea either. If a project moved to complete status, by all means, clean the no longer needed files. But for people that switch projects a lot, this could be much more unnecessary bandwidth on client and server side. If this could be user configurable, say set the tag to no task associated with project abc for "x" amount of days, then flush the associated files. That way it's up to the user, and leave default to something in the area of 90 days.

Sorry for the off topic.


I think you misunderstood something or I do^^

The idea is to remove the files of an deprecated app when no task of this app is in progress anymore.

https://github.com/BOINC/boinc/issues/2212
[Nov 5, 2017 10:50:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Operating system limits?

If there is no task on the client related to a specific science app, all related to that app will be removed.

Insufficient information. Who specifies the "specific science app", and how?

If it's the project saying an app is no longer needed as there's no more work, then that's fine. If it's the user in a control file, that's fine. There maybe other scenarios, but I can't think of any ...
[Nov 5, 2017 11:12:18 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Operating system limits?

If one looks at the posted issue link and the time line, one sees that Juha also put the finger on the same sore spot I commented on, so an actual project check is being added which apps are still maintained by the project. Now that throws a reverse spanner, since WCG keeps old apps on, just in case a client keeps asking for an old apps files... Is this a Catch 22? Only a project detach removes all trace of an old apps elements presently, though seem to remember such a mechanism of removing apps for which there was no task left on the client was already in place, but then at some point got disabled for the same concerned reason (would have to dig these forums, but am fairly sure).

YES it's a continuation of OT blushing
----------------------------------------
[Edit 1 times, last edit by SekeRob* at Nov 6, 2017 12:28:11 AM]
[Nov 6, 2017 12:25:11 AM]   Link   Report threatening or abusive post: please login first  Go to top 
mmonnin
Advanced Cruncher
Joined: Jul 20, 2016
Post Count: 148
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Operating system limits?

BOINC client supports a 1000 WU maximum at which point it receives a message indicating too many runnable tasks to any scheduler request. The 1000 limit is a fuzzy limit. If a client has 999 tasks the scheduler will send enough work to satisfy the request which means the client might have more than 1000 WUs but as long as the number is above 1000, you get the too many runnable tasks message


The limit must be higher now. I've been able to grab over 1200 WCG tasks on 32t machine before.
----------------------------------------

[Nov 6, 2017 4:23:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Operating system limits?

There's also the 70 per-active-thread buffer limit (used to be 35), but what the active overruling total limit is I've not seen as having been upgraded. Your message log would tell... just increase your buffer setting and see if you can hit the new wall. smile
[Nov 6, 2017 4:47:42 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 11   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread