Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 34
Posts: 34   Pages: 4   [ 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 4885 times and has 33 replies Next Thread
OldChap
Veteran Cruncher
UK
Joined: Jun 5, 2009
Post Count: 978
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Is it time to revisit the 35 WU limit?

I remember encountering this when the 4 core machine was really popular and 4c/8t were considered great

Time and technology have moved on so my 16c/32t machines are considered old hat and yet even these cannot "connect to the internet" every 7 days on projects where the runtime is short for each WU.

How folks cope with 64t up to 448t machines I have no clue

I find rigs need up to 240 wu per thread on my relatively slow machines to last the 10 days seen in settings.

The limits are a construct that serve only to annoy the user I think so what use are they? can we do away with them?
----------------------------------------

[Nov 14, 2018 1:21:22 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Is it time to revisit the 35 WU limit?

wasn't it changed to 70? I think I get 70 per core. Once you get up to about 16c, you start to hit the 1000 per machine hard-coded BOINC limit. I hit the 1000 limit on most of my machines except the 4c and 8c. 32c machines hit 1000 and can do those in about 30 hours. At least the short running WUs
You can create an app_config to limit the number of concurrently executing tasks and then set the n_cpu value in cc_config higher to get around the soft per core limit
----------------------------------------
[Edit 1 times, last edit by Doneske at Nov 14, 2018 1:35:34 PM]
[Nov 14, 2018 1:33:28 PM]   Link   Report threatening or abusive post: please login first  Go to top 
OldChap
Veteran Cruncher
UK
Joined: Jun 5, 2009
Post Count: 978
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Is it time to revisit the 35 WU limit?

Then maybe it is the 1000ish per core limit that needs addressing too

Multiply cores/threads by 35 here takes that to 1120 and as I said the most I have is 32t
----------------------------------------

[Nov 14, 2018 2:50:10 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Crystal Pellet
Veteran Cruncher
Joined: May 21, 2008
Post Count: 1316
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Is it time to revisit the 35 WU limit?

Then maybe it is the 1000ish per core limit that needs addressing too
.....

The 1000 tasks limit / project is a BOINC limitation (too many runnable tasks).
When you have < 1000 tasks, you get as many tasks as you need to fill your buffer
limited to what the project is assigning to your machine per single request.
For ZIKA I noticed, I mostly don't get more than 173 in 1 request, so in theory
you could get (in my example) a max of 1172 tasks in your buffer incl. running ones).
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by Crystal Pellet at Nov 16, 2018 8:35:19 AM]
[Nov 14, 2018 3:27:27 PM]   Link   Report threatening or abusive post: please login first  Go to top 
VietOZ
Senior Cruncher
United States
Joined: Apr 8, 2007
Post Count: 205
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Is it time to revisit the 35 WU limit?

For Zika, the max I can get was 1200 tasks on a TR 1950X
80 pages x 15 tasks per page = 1200

Not always hit that number but I've seen it on different machines as well.
----------------------------------------

if you are looking for a team please consider XtremeSystem Team
Team website: https://xs4s.org/
[Nov 14, 2018 4:17:53 PM]   Link   Report threatening or abusive post: please login first  Go to top 
KLiK
Master Cruncher
Croatia
Joined: Nov 13, 2006
Post Count: 3108
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Is it time to revisit the 35 WU limit?

+1
----------------------------------------
oldies:UDgrid.org & PS3 Life@home


non-profit org. Play4Life in Zagreb, Croatia
[Nov 15, 2018 2:39:08 PM]   Link   Report threatening or abusive post: please login first  Go to top 
hchc
Veteran Cruncher
USA
Joined: Aug 15, 2006
Post Count: 747
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Is it time to revisit the 35 WU limit?

Is this an issue that should be addressed on the BOINC GitHub? Even on my 4c/4t machines, I'm limited to getting 4 x 70 = 280 work units before I get the message "This machine has reached a limit on tasks in progress." On the current SCC1 short-running work units, my machine churns through its buffer in about 6-8 hours or so. I lose connectivity, which means this machine can be idle for an entire day. I'd much rather be able to buffer 1-2 days or more without some silly limit.

I'd like to see this 70 task/thread limit removed as well as the 1000 total tasks in progress limit.
----------------------------------------
  • i3-8100 (Coffee Lake, 4C/4T) @ 3.6 GHz
  • i5-4590 (Haswell, 4C/4T) @ 3.3 GHz
  • E5800 (Wolfdale, 2C/2T) @ 3.2 GHz

[Sep 18, 2019 8:20:33 PM]   Link   Report threatening or abusive post: please login first  Go to top 
giba
Veteran Cruncher
Brazil
Joined: Dec 2, 2004
Post Count: 846
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Is it time to revisit the 35 WU limit?

Well, my point is that any limit have concerns. Why limit if there are crunchers with hardware available to run tasks ? Don't make sense for me !
The central question on WCG ever was contribute to the Science using grid computing as much as possible, so why put limits if someone would like to contribute a little bit more tha others ? nerd idea good luck coffee peace
[Sep 19, 2019 12:36:00 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Is it time to revisit the 35 WU limit?

Is this an issue that should be addressed on the BOINC GitHub? Even on my 4c/4t machines, I'm limited to getting 4 x 70 = 280 work units before I get the message "This machine has reached a limit on tasks in progress." On the current SCC1 short-running work units, my machine churns through its buffer in about 6-8 hours or so. I lose connectivity, which means this machine can be idle for an entire day. I'd much rather be able to buffer 1-2 days or more without some silly limit.

I'd like to see this 70 task/thread limit removed as well as the 1000 total tasks in progress limit.

You can double or triple that number with just a few settings and a config code line, but you have to hit the books yourself to figure it out. Not a good idea to make this common knowledge. You'll hit the secondary codeline soon after as a machine is not allowed to have more than 1000 in progress. This defeats the workaround, ending up with even less than the 70 per thread. A 16 core can then have around 60.
----------------------------------------
[Edit 1 times, last edit by Former Member at Sep 19, 2019 6:55:40 AM]
[Sep 19, 2019 6:54:01 AM]   Link   Report threatening or abusive post: please login first  Go to top 
hchc
Veteran Cruncher
USA
Joined: Aug 15, 2006
Post Count: 747
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Is it time to revisit the 35 WU limit?

I believe I'm being misread. I'm saying that both the per core limit and the 1000 total limit should be eliminated, especially as multi-core CPUs keep coming to market. My only question is if this is something that should be raised as an issue on the BOINC GitHub.
----------------------------------------
  • i3-8100 (Coffee Lake, 4C/4T) @ 3.6 GHz
  • i5-4590 (Haswell, 4C/4T) @ 3.3 GHz
  • E5800 (Wolfdale, 2C/2T) @ 3.2 GHz

----------------------------------------
[Edit 2 times, last edit by hchc at Sep 19, 2019 9:16:20 AM]
[Sep 19, 2019 9:02:46 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 34   Pages: 4   [ 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread