Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 3593
Posts: 3593   Pages: 360   [ Previous Page | 351 352 353 354 355 356 357 358 359 360 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 5751759 times and has 3592 replies Next Thread
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

Thanks for the extended comparison, Al.

One 'fun' additional technical insight on one of my devices:

Each hour, a crontab job determines which ARP1-tasks of mine have finally validated. Then, for each of those results, all data from the belonging workunit as a whole are fetched and stored as a file into a directory named "ARP1" (surprise there!), together with all the other validated results. Each file will remain there for one month.

Adri
----------------------------------------
[Edit 1 times, last edit by adriverhoef at Jul 22, 2025 10:59:44 AM]
[Jul 22, 2025 10:55:19 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12594
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

For a couple of days I have been getting the message to the effect that ARP units are committed to other platforms. As my machines are Windows 7, that means that there are units available but not for Windows.

The inference here is that non-Windows machines have been downloading too many units to complete within the deadlines or, less likely, many errors are being made. Possibly both scenarios.

Downloading too many would be selfish and slow the project down.

Mike
----------------------------------------
[Edit 1 times, last edit by Mike.Gibson at Jul 26, 2025 1:40:30 AM]
[Jul 26, 2025 1:37:33 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 1293
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

As a non windows user... I get the same message. just fyi
I haven't gotten an ARP resend in a while.

At this moment. A user's larger queue isn't slowing down the project. The system not sending out available WUs is the thing slowing us down. I hope soon the system will be able to continuously send out fresh ARPs like before. Then someone hoarding with a big queue will be an issue. When that happens we can all argue about how to solve the problem. I really look forward to that discussion/argument. Though we have discussed it at length here on the forums before.

I have enough WUs for a day in my queue. I run two at a time, and I saw you suggestion of running 3 at a time, but why?? I'd get them done sooner, but then my computer would be idle.

When I can get a two day queue reliably, I will do more simultaneously. I will put more computers on the project, but at this moment of restricted flow, there is no rush.

I do hope that everyone is reasonable though in their queue size so everyone does get some. Not that everyone is kept busy at all times, but that everyone gets some to enjoy being part of the project. I truly believe that distributed projects have 2 goals. Science is one, and educating/participation is another.

I hope you get a few resends soon Mike
[Jul 26, 2025 4:08:38 AM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 1317
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

Joining Unixchick to point out that Linux users aren't getting work either, and will sometimes see that message... That said, there don't seem to be [m]any retries at the moment; perhaps most of the last backlog got cleared out as a side-effect of having two successive "lack of new work" intervals in rapid succession (and seeing off generation 148!), but give it another day or two and that message will show up regularly again sad

By the way, one other possible reason for "other platforms" might be 32-bit versus 64-bit... I allow for both cases on my systems and I occasionally get a Linux 32-bit ARP1 task (usually as a retry), but I know other users deliberately block 32-bit applications because they are slower; if 32-bit users miss deadlines, the scope for retries may be restricted if that's the case (whatever the O/S).

I also agree about the need to do something regarding the excessive number of missed deadline tasks; however, I fear that "user education" won't work so it's likely to have to be a technical solution.

Cheers - Al.

P.S. -- Mike, I'm sure you weren't singling out Linux for blame smile, and there's anecdotal evidence that the proportion of Windows tasks missing deadlines is probably similar to (if not greater than) that for Linux and Darwin combined...
[Jul 26, 2025 5:48:43 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12594
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

I wasn't pointing the finger at any one or group in particular. It was more a case of speculating why I have been getting a message continuously for a couple of days which indicates that there are some ARP units available but not for Windows.

If not for Windows then who? and why? Or is it a fake message?

Mike
[Jul 26, 2025 11:10:16 AM]   Link   Report threatening or abusive post: please login first  Go to top 
catchercradle
Senior Cruncher
England
Joined: Jan 16, 2009
Post Count: 167
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

And for those interested in climate work while waiting for more work here, CPDN has a batch of tasks out now. (about 1745 according to the server status. This is only updated about every two hours so may be higher or lower depending on whether the batch had finished uploading when the server state updated. Batch size was 3,900 tasks. When these run out or get close to it there is another batch of the same size going out. (There are some 32bit compatibility files needed for these batches. Details are under Linux section of CPDN fora. (both batches are Linux only as will be the multi-core tasks coming out soon that require 26GB RAM/task.)

Edit: Tasks were still being added to the hopper. Latest server status is over 2,600
----------------------------------------
[Edit 1 times, last edit by catchercradle at Jul 26, 2025 2:54:04 PM]
[Jul 26, 2025 1:57:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
AgrFan
Senior Cruncher
USA
Joined: Apr 17, 2008
Post Count: 396
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

Then someone hoarding with a big queue will be an issue. When that happens we can all argue about how to solve the problem. I really look forward to that discussion/argument. Though we have discussed it at length here on the forums before.

One possible solution is to limit the number of ARP downloads to one WU per system with the ability to override the restriction with a custom project setting. This restriction was used for the Clean Energy Project - Phase 2 (CEP2) due to high disk use and system performance concerns.

I suspect the WCG techs do not know about this or no longer have access to the scheduler code.
https://www.worldcommunitygrid.org/forums/wcg/viewthread_thread,30182
----------------------------------------

  • i5-10400 (Comet Lake, 6C/12T) @ 2.9 GHz
  • i5-7400 (Kaby Lake, 4C/4T) @ 3.0 GHz
  • i5-4590 (Haswell, 4C/4T) @ 3.3 GHz
  • i5-3330 (Ivy Bridge, 4C/4T) @ 3.0 GHz

----------------------------------------
[Edit 9 times, last edit by AgrFan at Jul 26, 2025 3:40:13 PM]
[Jul 26, 2025 2:53:31 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 1293
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

I
If not for Windows then who? and why? Or is it a fake message?

Mike


I'm curious about the message too.

| World Community Grid | No tasks are available for Africa Rainfall Project
| World Community Grid | Tasks are committed to other platforms

Is the tasks are committed message from ARP? or MCM ? I ask for both, so I'm guessing someone only running one or the other can answer that one.

I wish the log message was clearer.
I'm guessing it is just a "fake" message for I've got nothing for you, but it doesn't mean that the system has something for another system right at that moment, but maybe it had something for another system in the last "period of time" . Maybe it means I gave a different system a resend within the last 30 minutes ??

My vote is for poor message design.
[Jul 26, 2025 3:14:52 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TLD
Veteran Cruncher
USA
Joined: Jul 22, 2005
Post Count: 856
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

I am getting nothing on windows or linux.
----------------------------------------

[Jul 26, 2025 4:47:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 1317
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

I
If not for Windows then who? and why? Or is it a fake message?

Mike


I'm curious about the message too.

| World Community Grid | No tasks are available for Africa Rainfall Project
| World Community Grid | Tasks are committed to other platforms

Is the tasks are committed message from ARP? or MCM ? I ask for both, so I'm guessing someone only running one or the other can answer that one.
This has been mentioned in various threads in various forums in the past, including recently in the Chat Room's Project Status thread on 2025-07-21 -- probably worth repeating some of that here...

To work out which project(s) it actually applies to, look for an application that is missing from the list of "No tasks are available for ..." -- if only ARP1 and MCM1 are selected by the user, it's MCM1 that has tasks committed elsewhere in this case.

So Mike's repeated sightings of the message a couple of days ago were probably at the time there was a huge quantity of MCM1 retries for Linux tasks (I got nearly 100 on one day!); that is far from typical, by the way.
I wish the log message was clearer.
I'm guessing it is just a "fake" message for I've got nothing for you, but it doesn't mean that the system has something for another system right at that moment, but maybe it had something for another system in the last "period of time" . Maybe it means I gave a different system a resend within the last 30 minutes ??

My vote is for poor message design.
I think that guess is right for when the "other platforms" case applies. I'd need to do a code dive to confirm it but I suspect that message is probably produced by checking a flag rather than a list of affected applications, and I suspect it would only appear once if tasks for both ARP1 and MCM1 were committed elsewhere (with no "no tasks" line for either application!)

If that is the case, I doubt the message could be made much clearer, confusing though it might be. (Compare with "Too Late" versus "Can't use" on those Darwin validation failures...)

Cheers - Al.
[Jul 26, 2025 6:14:12 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 3593   Pages: 360   [ Previous Page | 351 352 353 354 355 356 357 358 359 360 | Next Page ]
[ Jump to Last Post ]
Post new Thread