Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 12
Posts: 12   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2752 times and has 11 replies Next Thread
bfmorse
Senior Cruncher
US
Joined: Jul 26, 2009
Post Count: 321
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Suggestion - RETURNS only metered connections - additional option

I have noticed "No Reply" WU's that go more than 6 or 7 days before their results are finally entered/returned and posted in the Result. Unfortunately, that usually means that RESENDS go out but may not get processed in time and end up with a SYSTEM ABORTED status. Kinda Frustrating for both the volunteers and the Research teams awaiting the results to move onto the next phase.

It may be that the volunteers that APPEAR to hoard WU's are in fact, running a larger than normal Queue merely because the have a metered connection (or some other restriction on their ability to connect and poll/return WU's in a timely manner).

I propose a modification to the BOINC client that would ADD an additional option to limit the system to permit ONLY the return of completed WU's during specific days/hours AND inhibiting the polling for NEW WU under that option. This would also allow the volunteer to reevaluate and possibly reduce the size of their queue.

This would use a much shorter time under a metered connection as it is limited to ONLY returning data, not polling for NEW WU. To pull new data, use what is there already for general metered connections but this new option would be limited to RETURNING COMPLETED WU's only.
[Jan 22, 2023 3:11:53 PM]   Link   Report threatening or abusive post: please login first  Go to top 
BobbyB
Veteran Cruncher
Canada
Joined: Apr 25, 2020
Post Count: 609
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Suggestion - RETURNS only metered connections - additional option

Sounds good but should that not be addressed to Berkeley. They wrote BOINC.
[Jan 22, 2023 3:41:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
bfmorse
Senior Cruncher
US
Joined: Jul 26, 2009
Post Count: 321
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Suggestion - RETURNS only metered connections - additional option

I tried there first. Unable to logon…

forgot password, requested email to reset password - never received email.

So next option for me was to post here.
[Jan 22, 2023 3:52:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7745
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Suggestion - RETURNS only metered connections - additional option

permit ONLY the return of completed WU's during specific days/hours AND inhibiting the polling for NEW WU under that option

This is already available under "options" "computing preference" "network". You can specify the times for the transfers of files.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jan 22, 2023 4:51:48 PM]   Link   Report threatening or abusive post: please login first  Go to top 
bfmorse
Senior Cruncher
US
Joined: Jul 26, 2009
Post Count: 321
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Suggestion - RETURNS only metered connections - additional option

I did not recall seeing an option to SEND ONLY.

Will double check when I return and update as appropriate.
----------------------------------------
[Edit 2 times, last edit by bfmorse at Jan 22, 2023 11:13:42 PM]
[Jan 22, 2023 6:37:39 PM]   Link   Report threatening or abusive post: please login first  Go to top 
bfmorse
Senior Cruncher
US
Joined: Jul 26, 2009
Post Count: 321
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Suggestion - RETURNS only metered connections - additional option

UPDATE: I can see the GENERAL options of limiting the window for connecting, polling and sending of files but did not find any reference to specifically limiting of Uploads only or Downloads only within predetermined allowed days and times.
From what I was able to determine, it appears that there is an ALL OR NOTHING option. but, not a selectable window:

For Example (days and times are arbitrary): ONLY Send files every day between 21:00 and 21:30 then poll to SEND and RECEIVE files between 01:00 and 02:00 on selected days per week.

Bruce
[Jan 22, 2023 11:14:47 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7745
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Suggestion - RETURNS only metered connections - additional option

UPDATE: I can see the GENERAL options of limiting the window for connecting, polling and sending of files but did not find any reference to specifically limiting of Uploads only or Downloads only within predetermined allowed days and times.
From what I was able to determine, it appears that there is an ALL OR NOTHING option. but, not a selectable window:

For Example (days and times are arbitrary): ONLY Send files every day between 21:00 and 21:30 then poll to SEND and RECEIVE files between 01:00 and 02:00 on selected days per week.

Bruce

Based on what I thought you needed, I thought this would suffice. If not, maybe it is a partial solution. I know of no other.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jan 22, 2023 11:44:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
PMH_UK
Veteran Cruncher
UK
Joined: Apr 26, 2007
Post Count: 777
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Suggestion - RETURNS only metered connections - additional option

This could be done by scripts calling BOINCCMD from CRONTAB:
no new tasks for project
allow network
update project
pause
disable network
allow tasks for project

Other scripts could get new work on time or manual
allow tasks for project
allow network
update project
pause
disable network

Paul.
----------------------------------------
Paul.
[Jan 23, 2023 10:26:31 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1968
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Suggestion - RETURNS only metered connections - additional option

This could be done by scripts calling BOINCCMD from CRONTAB:.
Which would only work on LInux.... wink


Beside that, and that this would be an option in the BOINC client, which WCG doesn't have anything really to do with (as someone else already mentioned, that due to the actual BOINC agent being developed and maintained by UC Berkley). I doubt that this is a realistic idea.
I seriously doubt that any issues of seeing recently more than usual resends (I got myself a whole bunch of _2s and a couple of _3s this morning) has anything to do with any "metered connection".

I rather think that is the (hopefully only temporary) result of the rather bad handling of the download/accessibility issues at WCG/Krembil in the past, which as lead to

a) a lot of people hoarding a lot more WUs than they used and more importantly, then they can actually process in the allotted amount of time and

b) a lot of people getting frustrated and not running their hosts (for WCG) at all, so that they time out or people just aborting them because "it's not the project that they like" (but the only one available right now)

That said, I had recently to abort a lot more WUs than usual due to a problem that I reported more than a couple of years ago with MCM1 WUs, but got the responds back then that it wouldn't be worth to try and fix this on the project side.
There is a thread in the support section where people complaining that MCM WUs "reset to zero", which could be one of the reasons for people ending up aborting them. I do have a somewhat different issue, that WUs run for a very long time, without ever finishing, until they either reach their due date or I notice it and abort them. They might run all the way to 100% or at least very close to it, in some cases at least in the high 90% range, though I had some being stuck in the 50%s or 70%s as well. It commonly starts with only one of 4/6/8/12/16/20 slots being stuck, while others are processing just fine. And if not noticed in time, another WU might come along and get stuck as well. I did have a couple hosts that I don't regularly monitor where all but 1 or 2 slots were all blocked by such stuck WUs. Unfortunately, I have not been able to pin this down to a certain batch or so, but I'll bring this like up again in the MCM section again shortly, in the past few month the system just hadn't been running consistently... sad

Ralf
----------------------------------------

[Jan 23, 2023 8:06:20 PM]   Link   Report threatening or abusive post: please login first  Go to top 
PMH_UK
Veteran Cruncher
UK
Joined: Apr 26, 2007
Post Count: 777
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Suggestion - RETURNS only metered connections - additional option

This could be done by scripts calling BOINCCMD from CRONTAB:. Which would only work on LInux.... wink


On Microsoft Windows, cron jobs are known as Scheduled Tasks.
They can be added through the Windows Task Scheduler user interface or powershell etc.

Paul.
----------------------------------------
Paul.
[Jan 23, 2023 8:44:51 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 12   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread