Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 39
Posts: 39   Pages: 4   [ Previous Page | 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 3877 times and has 38 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Task queueing when you know ahead of time a lack of net connection



@JETSOLVER, put 12 programmers in a room to code a program and you get 13 solutions... give it KISS and increase Connect and Buffer to your needs. One way order the other, the client will want to report any completed tasks when having the chance to go on line. It's not a must though... you have until deadline ;>)


Thanks all for the help, that was a direct solution to a simple problem, with a side trip through the possibilities...;)

Be good, be safe, be smart; all.
[Jul 7, 2009 5:37:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Task queueing when you know ahead of time a lack of net connection

Did not try beyond 4.41 days connect interval and 0.0 days buffer on the 6.6.36 test-bed, but got on that setting the full queue and more... 18 days, 20 hours and 17 minutes for a quad. That's including jobs under way 4.7 days per core. Seeing many observations posted at Berkeley and my own experience on mixing small and large resource projects of short and normal length jobs makes me stick to the advice to steer well away from this 6.6.36 "recommended" release. The 6.6.37 change log notes give no indication anything is done to the scheduling issues. My 6.2.28. duo client continues to run in continued tranquillity, exactly as per settings.

GPU crunchers of course can ignore this. They need 6.4 or 6.6, whichever version works for them. The 6.6.37 has a note with it that it now forces unloading GPU jobs if paused, regardless if check-pointed or not.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jul 17, 2009 8:05:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Task queueing when you know ahead of time a lack of net connection

So far, I've tried a few things.

using the panel below :



I have tried several things.

1). set the buffer size to 10 days. Got a slug of WU's and after having set it back to my previous 0.01 days additional buffer, I continually get significantly more WU's than I should.

2). Tried to set the connect every n days to 10. This is simply useless, the client / server do what they want without respect for this setting. Either fix it or get rid of the setting. One or the other.

3). Connect daily between the hours of xx:xx - xx:xx - again this seems to be a nice knob which appears to do absolutely nothing. I ran an experiment where I permitted connectivity between 23:30 - 23:31 and the client / server still communicated whenever they chose.

If you really want only to allow the client / server to communicate when you want them to, the only thing you can do is to use things like IPCONFIG /RELEASE and drop the connection for your whole system. Kind of silly this seems to be the only way to force WCG / Bionic / whatever to behave itself.

I'm fixin' to uninstall this stupid program and reinstall it and see if that will result in getting the application to work the way I want it to within my parameters.
[Jul 19, 2009 8:20:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Task queueing when you know ahead of time a lack of net connection

Barney, I wrote a sample FAQ for a specific scheme, so people could use that as a starting point. Setting the connect times will not be adhered to if you don't set the option in the activity menu, instead keep it on 'Network activity always available'. Seen the last few days the RTFM moniker being used. Indeed.

I've scripted, system scheduled, a swap and read of 2 global_prefs_override.xml's, so my unattended quad client connects twice a day, 15 minutes before the mid day and night UTC times. Outstanding feature request to have multiple times per day available, but given it's not filled yet, just acting as my own handyman.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jul 19, 2009 8:57:43 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Ingleside
Veteran Cruncher
Norway
Joined: Nov 19, 2005
Post Count: 974
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Task queueing when you know ahead of time a lack of net connection

I have tried several things.

1). set the buffer size to 10 days. Got a slug of WU's and after having set it back to my previous 0.01 days additional buffer, I continually get significantly more WU's than I should.

Well, I can't use v6.2.28 myself, so I'm (blissfully) ignorant on most of the bugs present in this client.

But, I've not seen anything to excess work-requests in v6.6.xx atleast (don't have CUDA so don't know about any CUDA-specific bugs).

2). Tried to set the connect every n days to 10. This is simply useless, the client / server do what they want without respect for this setting. Either fix it or get rid of the setting. One or the other.

This setting works, but the effects is probably unexpected for you due to WCG-tasks having a 10-day deadline. Due to the WCG-deadline, the effects very likely is:
1; Asks for a lot of WCG-work, and gets assigned some tasks.
2; Then tasks has been downloaded, client immediately starts running them in "high-priority"-mode. As long as WCG is in this mode, v6.2.xx will block all work-requests to WCG, except idle cpu.

If you tries "Connect..." either with a BOINC-project with longer deadlines, or if this setting is max 9 days then running WCG, it will most likely work more along your expectations.

3). Connect daily between the hours of xx:xx - xx:xx - again this seems to be a nice knob which appears to do absolutely nothing. I ran an experiment where I permitted connectivity between 23:30 - 23:31 and the client / server still communicated whenever they chose.

Well, in a quick test I can't find any problems with these settings, but there's 3 possible reasons it doesn't work for you:
1; Easily overlooked, if client is set to "Network activity always available", any preference-settings is overridden.
2; In case you've done something manually like hitting "update", or "Retry" or attaching to a project or something, this will enable network-connection even if disabled, and will be kept open for 5 minutes.
3; You've hit a bug. I'm aware there's been one or more bugs with the network-preferences, but don't remember which BOINC-clients was effected, so don't know if v6.2.28 is one of them.

If #3 is your problem, either upgrade to a current BOINC-client (not the WCG 'recommended'), or work-around this bug.
----------------------------------------


"I make so many mistakes. But then just think of all the mistakes I don't make, although I might."
[Jul 19, 2009 10:25:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Task queueing when you know ahead of time a lack of net connection

It's not a problem Ingleside. I run 6.2.28 and 6.6.36 and 5.10.45... they all work as designed, as far as this function is concerned for sure.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jul 19, 2009 10:29:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Ingleside
Veteran Cruncher
Norway
Joined: Nov 19, 2005
Post Count: 974
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Task queueing when you know ahead of time a lack of net connection

It's not a problem Ingleside. I run 6.2.28 and 6.6.36 and 5.10.45... they all work as designed, as far as this function is concerned for sure.

Good to know, wasn't sure with v6.2.xx, but did test both v5.10.45 and v6.6.37.
----------------------------------------


"I make so many mistakes. But then just think of all the mistakes I don't make, although I might."
[Jul 19, 2009 11:15:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Task queueing when you know ahead of time a lack of net connection

2). Tried to set the connect every n days to 10. This is simply useless, the client / server do what they want without respect for this setting. Either fix it or get rid of the setting. One or the other.

I confirm that this parameter has no effect on when the client will communicate with the server. Or at least no reliable effect.

In 6.2.28 I have tried this parameter to force periodical reporting of completed WUs while I am reducing the size of the queue (i.e. not requesting new work). No effect, as you say.

In 6.2.18 under Ubuntu I have seen it "work" once after setting this parameter to 0.25 for having reporting every 6 hours. After that I have seen one transaction for reporting completed WUs without asking for new work, but it happened 7 hours and 3 minutes after the previous one and not precisely 6 hours after. And when I reduced the "Connect every xx" parameter to lower values I have not seen any more "Reporting-only" transaction.

However, Barney, I want to be sure that you know that this "Connect every xx" parameter is not totally useless: it is added to the extra work value and it is the sum of both which determines the size of your job queue. Depending on the chronology of your changes that might explain why you were still receiving new work after setting back your extra work value to 0.01.

Cheers. Jean.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Jul 20, 2009 2:39:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Task queueing when you know ahead of time a lack of net connection

2; Then tasks has been downloaded, client immediately starts running them in "high-priority"-mode. As long as WCG is in this mode, v6.2.xx will block all work-requests to WCG, except idle cpu.

This is a common belief but it is simply wrong.
It seems to be true when the client switches to high priority mode because the estimated duration of all queued jobs has been suddenly increased after an exceptionally longer job completes. But in this case this is simply because the total estimated duration of all queud jobs has jumped by several hours at once and there is no reason to request new work before a while.

When it is only because you have several days of work queued the client goes on requesting new work as running tasks complete or progress, although all running tasks are in high priority mode, even with normal deadlines and without no risk of completing too late.
I have seen it these last days on three different devices, whether with 6.2.28 for the XP devices or with 6.2.18 under Ubuntu, until I decided to revert my extra work setting from 5 days to 0.5 yesterday.

Cheers. Jean.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Jul 20, 2009 2:54:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Task queueing when you know ahead of time a lack of net connection

The 'old function' of connect every X days was to act as a buffer replenisher at intervals and for dial-ups still of value. It always connected is set, results will be uploaded anyhow and since the efficiency rule seeks to minimize contacts, fetches work, if it has not done so before already. To me it's questionable that CAE is additive to AWB. Latter's purpose was to make sure people actually had what they wanted in queue, superseding the safeties that are part of the connect every X days function. Well, I typed a few days ago, that the safeties seem out. This morning had 6.5 days work per core on a connect setting of 3.41 days CAE and AWD on 0.00. All work looks to show perfectly normal TTC. Piles of HCMD2, so maybe there was a switch from longer (parent) to shorter work (see lots of grandchildren).

Barney does not say what client, but there are many reports of a seriously confused 6.6.36 scheduler. Well, I can attest to that. The above client is 6.6.36/quad.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jul 20, 2009 2:56:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 39   Pages: 4   [ Previous Page | 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread