Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 
World Community Grid Forums
  Category: Support
  Forum: BOINC Agent Support
  Thread: It's not enough, can I get more WUs to crunch?

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 10
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2093 times and has 9 replies Next Thread
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
It's not enough, can I get more WUs to crunch?
My computer can easily harbour 10 days worth of WUs, but in 1½ day it runs out of WUs.

Sometimes the network on my computer fails during long periods of time (several days) and then it runs quickly out of WUs. I understand that my client has a maximum of 280 WUs that it can hold during any moment. My BOINC client can crunch, let's say, eight WUs per hour. That's 24×8 = 192 WUs per day. In 1½ day it could crunch 192+96 = 288 WUs. So, after 1½ day my BOINC client runs out of WUs. Is it possible to build up a larger local pool of WUs to crunch? Do I need a stronger magnet or what? (rhetorical question) wink

(EDIT: UTF-8 turned into UTF-8'd UTF-8 after clicking "Post new thread")
----------------------------------------
[Edit 1 times, last edit by adriverhoef at Jul 31, 2016 11:59:06 AM]
[Jul 31, 2016 11:56:59 AM]   Link   Report threatening or abusive post: please login first  Go to top 
PMH_UK
Veteran Cruncher
UK
Joined: Apr 26, 2007
Post Count: 786
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: It's not enough, can I get more WUs to crunch?
My understanding is the limit is coded in the server to prevent overload.
This has been raised before and now CPUs are faster could be reviewed, at least for proven CPUs.

Paul.
----------------------------------------
Paul.
[Jul 31, 2016 12:03:52 PM]   Link   Report threatening or abusive post: please login first  Go to top 
KLiK
Master Cruncher
Croatia
Joined: Nov 13, 2006
Post Count: 3108
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: It's not enough, can I get more WUs to crunch?
Fix your network, until servers get updated! You have a better chance to do that...

Why?
There are people with 28c/56t computers here...crunching without a problem! ;)
----------------------------------------
oldies:UDgrid.org & PS3 Life@home


non-profit org. Play4Life in Zagreb, Croatia
[Jul 31, 2016 1:04:47 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: It's not enough, can I get more WUs to crunch?
Choose project(s) that have the longest average runtime such as MCM or FAH2, noting that latter requires more or less constant network availability to report the intermediate progress trickles AND they have a fixed 4 day deadline. HST is hard to get but those are kind of longest running with 10 day deadline.

The cap is 35 per core and if you do a Dirty Harry you can easily double, but you'll need to RTFM the cc_config.xml manual... not going to give hack lessons ;o)))
[Jul 31, 2016 2:03:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: It's not enough, can I get more WUs to crunch?
Indeed, "fix your network", KLiK, if I knew what was wrong. Downloading a stream from an Internet radio station continues and works all the time (so the Internet connection works without a hitch) while BOINC suddenly starts stalling. I have 10,000 lines of Event Log (without any debugging-options) where the problem arises, with lines like:

BOINC can't access Internet - check network connection or proxy configuration.
Internet access OK - project servers may be temporarily down.
Not requesting tasks: some download is stalled
Not requesting tasks: too many uploads in progress
Project communication failed: attempting access to reference site
Scheduler request failed: SSL connect error
transient HTTP error

Can't get my hands on the problem. Once the queue dries out the problem slowly goes away and the BOINC connection is restored within a few days. This past week I've noticed the problem this Thursday morning, lasting about two days, and also this Saturday evening. I was thinking if I can get 10 days worth of computing on my computer than it can happily crunch on till I'm back to clear the problem and it would still be in time.

Rob, I see what you mean now with "cap is 35 per core". May try that, too, once I'm back. Indeed, one hack of a Dirty Harry job. :-)
----------------------------------------
[Edit 7 times, last edit by adriverhoef at Jul 31, 2016 4:29:15 PM]
[Jul 31, 2016 3:47:14 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: It's not enough, can I get more WUs to crunch?
"Een goed verstaander heeft maar een half woord nodig" or something along those lines

If related to "No Close Tag In Scheduler Reply", check out this thread as of here https://secure.worldcommunitygrid.org/forums/wcg/viewpostinthread?post=526581
There are several threads on same and one has a post by uplinger where he wrote to be working on it. No log though, so pure [educated] guess tongue
[Jul 31, 2016 7:00:48 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: It's not enough, can I get more WUs to crunch?
Thanks Rob, will try that to see if something comes up. The other machine (b) still hasn't contacted WCG since 7/30/16 19:49:34, while I'm having only access to the machine here (a).

In the meantime I derived from my Event Log this cuty (on machine a):
- excuses for this lengthy message -

28-Jul-2016 16:37:04 [World Community Grid] Started upload of OET1_0003873_x3Q7C_rig_70893_0_r2084527364_0
28-Jul-2016 16:37:15 [World Community Grid] Finished upload of OET1_0003873_x3Q7C_rig_70893_0_r2084527364_0
28-Jul-2016 16:45:19 [World Community Grid] Sending scheduler request: To report completed tasks.
28-Jul-2016 16:45:19 [World Community Grid] Reporting 9 completed tasks
28-Jul-2016 16:45:19 [World Community Grid] Requesting new tasks for CPU
28-Jul-2016 16:45:29 [---] Project communication failed: attempting access to reference site
28-Jul-2016 16:45:29 [World Community Grid] Scheduler request failed: Unrecognized or bad HTTP Content or Transfer-Encoding
28-Jul-2016 16:45:32 [---] Internet access OK - project servers may be temporarily down.
[..]
28-Jul-2016 16:47:29 [World Community Grid] Sending scheduler request: To report completed tasks.
28-Jul-2016 16:47:29 [World Community Grid] Reporting 10 completed tasks
28-Jul-2016 16:47:29 [World Community Grid] Requesting new tasks for CPU
28-Jul-2016 16:47:38 [World Community Grid] Scheduler request completed: got 9 new tasks

Two days later:

30-Jul-2016 16:24:51 [World Community Grid] Sending scheduler request: To report completed tasks.
30-Jul-2016 16:24:51 [World Community Grid] Reporting 6 completed tasks
30-Jul-2016 16:24:51 [World Community Grid] Requesting new tasks for CPU
30-Jul-2016 16:25:05 [World Community Grid] Scheduler request completed: got 6 new tasks
30-Jul-2016 16:25:07 [World Community Grid] Started download of 555f9eae46f98279c4a5c1a1d032dd9a.job
30-Jul-2016 16:25:07 [World Community Grid] Started download of 19e7250d1c76c18a556237bd7f68aa57.zip
30-Jul-2016 16:25:31 [---] Project communication failed: attempting access to reference site
30-Jul-2016 16:25:31 [World Community Grid] Finished download of 555f9eae46f98279c4a5c1a1d032dd9a.job
30-Jul-2016 16:25:31 [World Community Grid] Temporarily failed download of 19e7250d1c76c18a556237bd7f68aa57.zip: transient HTTP error
30-Jul-2016 16:25:31 [World Community Grid] Backing off 00:02:47 on download of 19e7250d1c76c18a556237bd7f68aa57.zip
30-Jul-2016 16:25:31 [World Community Grid] Started download of ecb6209e9b6b04942b7076d7fe1a384d.job
30-Jul-2016 16:25:31 [World Community Grid] Started download of 220fd94009ea4d90ded4368765e953ea.zip
30-Jul-2016 16:25:44 [---] Internet access OK - project servers may be temporarily down.
30-Jul-2016 16:25:44 [World Community Grid] Finished download of ecb6209e9b6b04942b7076d7fe1a384d.job
30-Jul-2016 16:25:44 [World Community Grid] Finished download of 220fd94009ea4d90ded4368765e953ea.zip
30-Jul-2016 16:25:44 [World Community Grid] Started download of 288aeb2df0f94c0a0dd4cb4f7391e48c.job
30-Jul-2016 16:25:44 [World Community Grid] Started download of a7674036fcdf048c7c9be417122cd8c7.zip
30-Jul-2016 16:25:57 [World Community Grid] Finished download of 288aeb2df0f94c0a0dd4cb4f7391e48c.job
30-Jul-2016 16:25:57 [World Community Grid] Finished download of a7674036fcdf048c7c9be417122cd8c7.zip
30-Jul-2016 16:25:57 [World Community Grid] Started download of 9a0f95e0842e55eb895d172f3a963c3f.job
30-Jul-2016 16:25:57 [World Community Grid] Started download of ce4ff8f167ae7e81e8c49452741b2212.zip
30-Jul-2016 16:26:10 [World Community Grid] Finished download of 9a0f95e0842e55eb895d172f3a963c3f.job
30-Jul-2016 16:26:10 [World Community Grid] Finished download of ce4ff8f167ae7e81e8c49452741b2212.zip
30-Jul-2016 16:26:10 [World Community Grid] Started download of f6238b542e1cda8a733ef545faacb619.job
30-Jul-2016 16:26:10 [World Community Grid] Started download of 8ffa0fd0edacaea3ac350fb29f78141a.zip
30-Jul-2016 16:26:21 [World Community Grid] Finished download of f6238b542e1cda8a733ef545faacb619.job
30-Jul-2016 16:26:21 [World Community Grid] Started download of 05d29416160d5c4c22deddf0115e2f27.job
30-Jul-2016 16:26:29 [World Community Grid] Finished download of 8ffa0fd0edacaea3ac350fb29f78141a.zip
30-Jul-2016 16:26:29 [World Community Grid] Finished download of 05d29416160d5c4c22deddf0115e2f27.job
30-Jul-2016 16:26:29 [World Community Grid] Started download of d9a2dd6429baf95db8b4e243ea33e47e.zip
30-Jul-2016 16:26:30 [World Community Grid] Finished download of d9a2dd6429baf95db8b4e243ea33e47e.zip
30-Jul-2016 16:28:19 [World Community Grid] Started download of 19e7250d1c76c18a556237bd7f68aa57.zip
30-Jul-2016 16:28:32 [World Community Grid] Finished download of 19e7250d1c76c18a556237bd7f68aa57.zip

Above we can note that all downloads take more than 10 seconds except one that takes only one second. One second should be normal.
Also note that at 16:26:30 it takes 109 seconds to start the next download at 16:28:19, thanks to the "Backing off 00:02:47" at 16:25:31. :-)

One hour later:

30-Jul-2016 17:29:34 [World Community Grid] Sending scheduler request: To report completed tasks.
30-Jul-2016 17:29:34 [World Community Grid] Reporting 8 completed tasks
30-Jul-2016 17:29:34 [World Community Grid] Requesting new tasks for CPU
30-Jul-2016 17:29:49 [World Community Grid] Scheduler request completed: got 8 new tasks
30-Jul-2016 17:29:51 [World Community Grid] Started download of 33888f06a54cf879eb56f4587894b8e5.job
30-Jul-2016 17:29:51 [World Community Grid] Started download of a6753cccbd920e74ee6d7cfa580f71f7.zip
30-Jul-2016 17:30:16 [---] Project communication failed: attempting access to reference site
30-Jul-2016 17:30:16 [World Community Grid] Temporarily failed download of 33888f06a54cf879eb56f4587894b8e5.job: transient HTTP error
30-Jul-2016 17:30:16 [World Community Grid] Backing off 00:03:25 on download of 33888f06a54cf879eb56f4587894b8e5.job
30-Jul-2016 17:30:16 [World Community Grid] Finished download of a6753cccbd920e74ee6d7cfa580f71f7.zip
30-Jul-2016 17:30:16 [World Community Grid] Started download of 98faac5358bae977952b686def737b28.job
30-Jul-2016 17:30:16 [World Community Grid] Started download of d730d52fc9cf514f090de7e11f07724e.zip
30-Jul-2016 17:30:41 [---] Internet access OK - project servers may be temporarily down.
30-Jul-2016 17:30:41 [World Community Grid] Finished download of 98faac5358bae977952b686def737b28.job
30-Jul-2016 17:30:41 [World Community Grid] Temporarily failed download of d730d52fc9cf514f090de7e11f07724e.zip: transient HTTP error
30-Jul-2016 17:30:41 [World Community Grid] Backing off 00:02:28 on download of d730d52fc9cf514f090de7e11f07724e.zip
30-Jul-2016 17:30:41 [World Community Grid] Started download of 0960be7ea257e953b025f7fb4e1baa57.job
30-Jul-2016 17:30:41 [World Community Grid] Started download of a4cdf1994dc5c53b6d8e90bbeb05bff6.zip
30-Jul-2016 17:30:54 [World Community Grid] Finished download of 0960be7ea257e953b025f7fb4e1baa57.job
30-Jul-2016 17:30:54 [World Community Grid] Finished download of a4cdf1994dc5c53b6d8e90bbeb05bff6.zip
30-Jul-2016 17:30:54 [World Community Grid] Started download of 3ff0b0b68ce25c1c2bf8a16d9be566ff.job
30-Jul-2016 17:30:54 [World Community Grid] Started download of 476143d9e36a4a59999a202c8f270ec0.zip
30-Jul-2016 17:31:06 [World Community Grid] Finished download of 3ff0b0b68ce25c1c2bf8a16d9be566ff.job
30-Jul-2016 17:31:06 [World Community Grid] Started download of fb5497fc67e3351dfef35f9635dc3714.job
30-Jul-2016 17:31:14 [World Community Grid] Finished download of 476143d9e36a4a59999a202c8f270ec0.zip
30-Jul-2016 17:31:14 [World Community Grid] Finished download of fb5497fc67e3351dfef35f9635dc3714.job
30-Jul-2016 17:31:14 [World Community Grid] Started download of 36b4f3f0177e2e3c7101a1654e3137e5.zip
30-Jul-2016 17:31:14 [World Community Grid] Started download of 6790c71c4f588f6e61edaf351b26b7e2.job
30-Jul-2016 17:31:15 [World Community Grid] Finished download of 36b4f3f0177e2e3c7101a1654e3137e5.zip
30-Jul-2016 17:31:15 [World Community Grid] Finished download of 6790c71c4f588f6e61edaf351b26b7e2.job
30-Jul-2016 17:31:15 [World Community Grid] Started download of e712234468dde8f9aed32f5e49c214a4.zip
30-Jul-2016 17:31:15 [World Community Grid] Started download of c9bf9e54e8ce1964bd02110de3c7c1a8.job
30-Jul-2016 17:31:16 [World Community Grid] Finished download of e712234468dde8f9aed32f5e49c214a4.zip
30-Jul-2016 17:31:16 [World Community Grid] Finished download of c9bf9e54e8ce1964bd02110de3c7c1a8.job
30-Jul-2016 17:31:16 [World Community Grid] Started download of 68917f0ea3063419a90d27bf6229ed7d.zip
30-Jul-2016 17:31:16 [World Community Grid] Started download of adc87987c704762704a40054b1ce32ac.job
30-Jul-2016 17:31:17 [World Community Grid] Finished download of 68917f0ea3063419a90d27bf6229ed7d.zip
30-Jul-2016 17:31:17 [World Community Grid] Finished download of adc87987c704762704a40054b1ce32ac.job
30-Jul-2016 17:31:17 [World Community Grid] Started download of d8fb1d407e845147487b0fa11697f387.zip
30-Jul-2016 17:31:18 [World Community Grid] Finished download of d8fb1d407e845147487b0fa11697f387.zip
30-Jul-2016 17:33:11 [World Community Grid] Started download of d730d52fc9cf514f090de7e11f07724e.zip
30-Jul-2016 17:33:23 [World Community Grid] Finished download of d730d52fc9cf514f090de7e11f07724e.zip
30-Jul-2016 17:33:43 [World Community Grid] Started download of 33888f06a54cf879eb56f4587894b8e5.job
30-Jul-2016 17:33:56 [World Community Grid] Finished download of 33888f06a54cf879eb56f4587894b8e5.job

In firebrick red the starting times of the delayed downloads thanks to the two "Backing off"-messages.

Then, to keep it somewhat shorter - and all downloads succeed eventually in each hourly session so far:
30-Jul-2016 18:44:02 - no transient HTTP errors.

30-Jul-2016 20:00:53 [World Community Grid] Reporting 8 completed tasks
30-Jul-2016 20:01:35 [World Community Grid] Temporarily failed download of a47c879f49523ee15f7aa7643e6c79c4.job: transient HTTP error

30-Jul-2016 21:03:52 [World Community Grid] Reporting 7 completed tasks
30-Jul-2016 21:04:35 [World Community Grid] Temporarily failed download of d21072dc4ac2546986b7ba63e11310ae.zip: transient HTTP error

31-Jul-2016 02:48:04 - no transient HTTP errors.

31-Jul-2016 03:55:31 [World Community Grid] Reporting 8 completed tasks
31-Jul-2016 03:56:16 [World Community Grid] Temporarily failed download of 2acd4fd934379006711b21a7b264e4ba.zip: transient HTTP error

31-Jul-2016 05:20:07 [World Community Grid] Reporting 8 completed tasks
31-Jul-2016 05:20:52 [World Community Grid] Temporarily failed download of 10cff1882c2a77e13216d13724ab6371.zip: transient HTTP error

31-Jul-2016 06:38:25 - no transient HTTP errors.

31-Jul-2016 07:59:00 [World Community Grid] Reporting 8 completed tasks
31-Jul-2016 07:59:46 [World Community Grid] Temporarily failed download of 3fe18eaeb571da9c31308bb90bddac04.zip: transient HTTP error

31-Jul-2016 09:15:29 [World Community Grid] Reporting 8 completed tasks
31-Jul-2016 09:16:18 [World Community Grid] Temporarily failed download of 0a1f581aee193d72c85d964f4af72e54.job: transient HTTP error

31-Jul-2016 10:27:39 - no transient HTTP errors.

31-Jul-2016 11:35:37 [World Community Grid] Reporting 8 completed tasks
31-Jul-2016 11:36:26 [World Community Grid] Temporarily failed download of fce979812e9aaa89d45b49d8d7fe4e7f.zip: transient HTTP error

31-Jul-2016 12:44:44 [World Community Grid] Reporting 8 completed tasks
31-Jul-2016 12:45:27 [World Community Grid] Temporarily failed download of 18048c9933ba6a03e3bb200cdbb603db.zip: transient HTTP error

and so on, etc. and at this moment, one day later, after setting 'unparsed_xml':
01-Aug-2016 11:49:43 [---] log flags: file_xfer, sched_ops, task, unparsed_xml
01-Aug-2016 11:55:48 - no transient HTTP errors.
01-Aug-2016 12:56:57 - no transient HTTP errors.
01-Aug-2016 14:01:53 - no transient HTTP errors.
[Aug 1, 2016 12:17:46 PM]   Link   Report threatening or abusive post: please login first  Go to top 
KLiK
Master Cruncher
Croatia
Joined: Nov 13, 2006
Post Count: 3108
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: It's not enough, can I get more WUs to crunch?
Have you made an exception for BOINC in your firewall?

Choose project(s) that have the longest average runtime such as MCM or FAH2, noting that latter requires more or less constant network availability to report the intermediate progress trickles AND they have a fixed 4 day deadline. HST is hard to get but those are kind of longest running with 10 day deadline.

The cap is 35 per core and if you do a Dirty Harry you can easily double, but you'll need to RTFM the cc_config.xml manual... not going to give hack lessons ;o)))

FAH2 has intermittent results delivery within WUs...so that's not going to work for him!
----------------------------------------
oldies:UDgrid.org & PS3 Life@home


non-profit org. Play4Life in Zagreb, Croatia
[Aug 2, 2016 6:25:24 AM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: It's not enough, can I get more WUs to crunch?
At this moment BOINC doesn't have a problem connecting to WCG, so why should I make an exception for BOINC in my firewall? Doesn't sound logical to me. Please explain, KLiK. confused
----------------------------------------
[Edit 2 times, last edit by adriverhoef at Aug 6, 2016 12:55:08 PM]
[Aug 6, 2016 12:50:18 PM]   Link   Report threatening or abusive post: please login first  Go to top 
No2L
Cruncher
Joined: Jun 6, 2008
Post Count: 10
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: It's not enough, can I get more WUs to crunch?
Hummm... I may need to reboot my system including modem & router. We have AT&T U, and we did loose connection, requiring a reboot on the TV cable box. I'll take care of that. Thanks, Ann
[Aug 7, 2016 3:07:44 AM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread