Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 18
Posts: 18   Pages: 2   [ Previous Page | 1 2 ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2927 times and has 17 replies Next Thread
Mamajuanauk
Master Cruncher
United Kingdom
Joined: Dec 15, 2012
Post Count: 1900
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 35 WU Limit too Small

NixChix - Can I suggest you post some of your settings, as it may be an issue with settings restricting how many WU's are cached.

The reason I ask is I have some 8 core machines (only a couple left) that happily cache 280 WU's. This machine is set to run as follows:
    100% processor
    100% of the time
    Cache is 3.5 days
    Disk space is 30Gb
Some or all of your settings may define how many WU's are cached.

For example, if you have only set to run 20% of 4 cores, it would lead to 1 processor x 35 WU's

On my 64 core machines I regularly see 2240 WU's in the cache...
----------------------------------------
Mamajuanauk is the Name! Crunching is the Game!



[Jun 19, 2015 7:21:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
theodolite
Advanced Cruncher
Joined: Apr 11, 2014
Post Count: 119
Status: Offline
Reply to this Post  Reply with Quote 
Re: 35 WU Limit too Small

Couple of thoughts.

Wouldn't it be great to have 4 x i7 computers and unlimited WU so I could load up with 30,000 of short .25 hour OET WU (you can do the math) so that no one else could get any WU. That would be so righteous. devilish

I'm someone who is happy simply to increase my IP from 12 to 52 pages while supply lasts biggrin and when the longer WU come back, I'll go back to about 12 pages of IP again. smile

Last I saw, this was a DC project, not focused on a single person's ego. tongue
[Jun 19, 2015 7:42:37 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7581
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 35 WU Limit too Small

I assume that oet has same runtimes as fah (~30 minutes/wu.

Even though OET is a VINA project the run times are highly variable with reports of anywhere from 10 minutes to several hours. Just depends on the batch.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jun 19, 2015 8:21:43 PM]   Link   Report threatening or abusive post: please login first  Go to top 
NixChix
Veteran Cruncher
United States
Joined: Apr 29, 2007
Post Count: 1187
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 35 WU Limit too Small

I was getting the full 35-per-core limit on WUs. The problem is that when they take just 15 minutes or less. I am out of town for a wedding at the moment and can't access by BOINCtasks history. The WCG results page already purged the completed WU history, so I can't get actual data. I was seeing 15-20 minutes run-time estimates with a total queue size of 6 hours (24 hrs / 4 cores). The slower crunchers had longer estimates.

The whole purpose of a queue was to be able to store up a few days of work to cover dry periods. Of course there should be a limit. It should be what you can (and have) crunch in the time allotted for the work. An arbitrary cap of 35 favors slow, intermittent members at the expense of the workhorses. If the job sizes are highly variable and are impossible to size for a specific crunchers's capability, then that just demonstrates why a one-size-fits-all limit of 35 was just plain wrong.

Cheers coffee
----------------------------------------

[Jun 20, 2015 8:06:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Byteball_730a2960
Senior Cruncher
Joined: Oct 29, 2010
Post Count: 318
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 35 WU Limit too Small

I don't get it. Is this computer not connected to the internet 24/7?
If so, why would you need to babysit the computer.

The only computer I have an issue with is a laptop that runs 23.5/7 but is only connected to the internet twice a week. Otherwise, every other computer is fine as long as my buffer settings are sufficient
[Jun 22, 2015 12:23:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
NixChix
Veteran Cruncher
United States
Joined: Apr 29, 2007
Post Count: 1187
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 35 WU Limit too Small

I don't get it. Is this computer not connected to the internet 24/7?
If so, why would you need to babysit the computer.

The only computer I have an issue with is a laptop that runs 23.5/7 but is only connected to the internet twice a week. Otherwise, every other computer is fine as long as my buffer settings are sufficient
Tried to have the lil' crunchers queues partially filled and working hard on OET while still asking for only FAAH work. Fill them with 2 or 3 days of work and then change project selection on the profile. Repeat every 2 or 3 days. It used to be a valid technique when trying to get work for projects when the work flow was sporadic, just like FAAH when the supply of original WUs came to an end and only resends were going out.

BTW, the length of the OET WUs has increased somewhat lately. Point is moot since FAAH WUs are now rarer than hen's teeth (239 returned yesterday). The 35 WU limit is still lame.

Cheers coffee
----------------------------------------

[Jun 28, 2015 6:39:52 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: 35 WU Limit too Small

A side problem is, it's an over-all limit, not a per-science [If only we could set a Max In Progress per science in the app_config.xml with a server side controlled cap **]. 35 for MCM gets you easily overloaded... they take 9 hours on my half [summer] speed 4770, and that means 35 IP = 13 days is possible, were it not the deadline is 7.

** This would allow us to also balance much more what's crunched at a local level without risking idle cores, but mostly this tiring alternation of profile settings would not be needed, buffer lots of one, then switch profile to go netting for something else]. Now have one device that does OET+UGM. Getting many more OET than UGM, so set latter to max compute at 4 of 8. If FIFO determines UGM is older there will always be 4 UGM running, but if few, OET can take it all, or get priority if aged more than UGM. So far see a nice constant 4&4 compute of OET&UGM with a 1.5 day buffer depth. [/Off Trail]
[Jun 28, 2015 10:32:52 AM]   Link   Report threatening or abusive post: please login first  Go to top 
KLiK
Master Cruncher
Croatia
Joined: Nov 13, 2006
Post Count: 3108
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 35 WU Limit too Small

Don't know about octo-cores...

But my quad-cores have all app_config.xml file to run only 1 CEP2 project & 3 of any of the other projects: FA@h, OET, MCM, UGM...& it works just fine! Even though I'm just crunching only UGM & OET currently with optional projects added if there r no jobs on server...

maybe same numbers would work on octo-cores? so 6:2...
wink
----------------------------------------
oldies:UDgrid.org & PS3 Life@home


non-profit org. Play4Life in Zagreb, Croatia
[Jun 29, 2015 6:17:07 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 18   Pages: 2   [ Previous Page | 1 2 ]
[ Jump to Last Post ]
Post new Thread