| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
| World Community Grid Forums
|
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 3593
|
|
| Author |
|
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2346 Status: Offline Project Badges:
|
Thanks for the extended comparison, Al.
----------------------------------------One 'fun' additional technical insight on one of my devices: Each hour, a crontab job determines which ARP1-tasks of mine have finally validated. Then, for each of those results, all data from the belonging workunit as a whole are fetched and stored as a file into a directory named "ARP1" (surprise there!), together with all the other validated results. Each file will remain there for one month. Adri [Edit 1 times, last edit by adriverhoef at Jul 22, 2025 10:59:44 AM] |
||
|
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12594 Status: Offline Project Badges:
|
For a couple of days I have been getting the message to the effect that ARP units are committed to other platforms. As my machines are Windows 7, that means that there are units available but not for Windows.
----------------------------------------The inference here is that non-Windows machines have been downloading too many units to complete within the deadlines or, less likely, many errors are being made. Possibly both scenarios. Downloading too many would be selfish and slow the project down. Mike [Edit 1 times, last edit by Mike.Gibson at Jul 26, 2025 1:40:30 AM] |
||
|
|
Unixchick
Veteran Cruncher Joined: Apr 16, 2020 Post Count: 1293 Status: Offline Project Badges:
|
As a non windows user... I get the same message. just fyi
I haven't gotten an ARP resend in a while. At this moment. A user's larger queue isn't slowing down the project. The system not sending out available WUs is the thing slowing us down. I hope soon the system will be able to continuously send out fresh ARPs like before. Then someone hoarding with a big queue will be an issue. When that happens we can all argue about how to solve the problem. I really look forward to that discussion/argument. Though we have discussed it at length here on the forums before. I have enough WUs for a day in my queue. I run two at a time, and I saw you suggestion of running 3 at a time, but why?? I'd get them done sooner, but then my computer would be idle. When I can get a two day queue reliably, I will do more simultaneously. I will put more computers on the project, but at this moment of restricted flow, there is no rush. I do hope that everyone is reasonable though in their queue size so everyone does get some. Not that everyone is kept busy at all times, but that everyone gets some to enjoy being part of the project. I truly believe that distributed projects have 2 goals. Science is one, and educating/participation is another. I hope you get a few resends soon Mike |
||
|
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 1317 Status: Offline Project Badges:
|
Joining Unixchick to point out that Linux users aren't getting work either, and will sometimes see that message... That said, there don't seem to be [m]any retries at the moment; perhaps most of the last backlog got cleared out as a side-effect of having two successive "lack of new work" intervals in rapid succession (and seeing off generation 148!), but give it another day or two and that message will show up regularly again
![]() By the way, one other possible reason for "other platforms" might be 32-bit versus 64-bit... I allow for both cases on my systems and I occasionally get a Linux 32-bit ARP1 task (usually as a retry), but I know other users deliberately block 32-bit applications because they are slower; if 32-bit users miss deadlines, the scope for retries may be restricted if that's the case (whatever the O/S). I also agree about the need to do something regarding the excessive number of missed deadline tasks; however, I fear that "user education" won't work so it's likely to have to be a technical solution. Cheers - Al. P.S. -- Mike, I'm sure you weren't singling out Linux for blame , and there's anecdotal evidence that the proportion of Windows tasks missing deadlines is probably similar to (if not greater than) that for Linux and Darwin combined... |
||
|
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12594 Status: Offline Project Badges:
|
I wasn't pointing the finger at any one or group in particular. It was more a case of speculating why I have been getting a message continuously for a couple of days which indicates that there are some ARP units available but not for Windows.
If not for Windows then who? and why? Or is it a fake message? Mike |
||
|
|
catchercradle
Senior Cruncher England Joined: Jan 16, 2009 Post Count: 167 Status: Offline Project Badges:
|
And for those interested in climate work while waiting for more work here, CPDN has a batch of tasks out now. (about 1745 according to the server status. This is only updated about every two hours so may be higher or lower depending on whether the batch had finished uploading when the server state updated. Batch size was 3,900 tasks. When these run out or get close to it there is another batch of the same size going out. (There are some 32bit compatibility files needed for these batches. Details are under Linux section of CPDN fora. (both batches are Linux only as will be the multi-core tasks coming out soon that require 26GB RAM/task.)
----------------------------------------Edit: Tasks were still being added to the hopper. Latest server status is over 2,600 [Edit 1 times, last edit by catchercradle at Jul 26, 2025 2:54:04 PM] |
||
|
|
AgrFan
Senior Cruncher USA Joined: Apr 17, 2008 Post Count: 396 Status: Recently Active Project Badges:
|
Then someone hoarding with a big queue will be an issue. When that happens we can all argue about how to solve the problem. I really look forward to that discussion/argument. Though we have discussed it at length here on the forums before. One possible solution is to limit the number of ARP downloads to one WU per system with the ability to override the restriction with a custom project setting. This restriction was used for the Clean Energy Project - Phase 2 (CEP2) due to high disk use and system performance concerns. I suspect the WCG techs do not know about this or no longer have access to the scheduler code. https://www.worldcommunitygrid.org/forums/wcg/viewthread_thread,30182
[Edit 9 times, last edit by AgrFan at Jul 26, 2025 3:40:13 PM] |
||
|
|
Unixchick
Veteran Cruncher Joined: Apr 16, 2020 Post Count: 1293 Status: Offline Project Badges:
|
I If not for Windows then who? and why? Or is it a fake message? Mike I'm curious about the message too. | World Community Grid | No tasks are available for Africa Rainfall Project | World Community Grid | Tasks are committed to other platforms Is the tasks are committed message from ARP? or MCM ? I ask for both, so I'm guessing someone only running one or the other can answer that one. I wish the log message was clearer. I'm guessing it is just a "fake" message for I've got nothing for you, but it doesn't mean that the system has something for another system right at that moment, but maybe it had something for another system in the last "period of time" . Maybe it means I gave a different system a resend within the last 30 minutes ?? My vote is for poor message design. |
||
|
|
TLD
Veteran Cruncher USA Joined: Jul 22, 2005 Post Count: 856 Status: Offline Project Badges:
|
I am getting nothing on windows or linux.
----------------------------------------![]() |
||
|
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 1317 Status: Offline Project Badges:
|
I If not for Windows then who? and why? Or is it a fake message? Mike I'm curious about the message too. | World Community Grid | No tasks are available for Africa Rainfall Project | World Community Grid | Tasks are committed to other platforms Is the tasks are committed message from ARP? or MCM ? I ask for both, so I'm guessing someone only running one or the other can answer that one. To work out which project(s) it actually applies to, look for an application that is missing from the list of "No tasks are available for ..." -- if only ARP1 and MCM1 are selected by the user, it's MCM1 that has tasks committed elsewhere in this case. So Mike's repeated sightings of the message a couple of days ago were probably at the time there was a huge quantity of MCM1 retries for Linux tasks (I got nearly 100 on one day!); that is far from typical, by the way. I wish the log message was clearer. I think that guess is right for when the "other platforms" case applies. I'd need to do a code dive to confirm it but I suspect that message is probably produced by checking a flag rather than a list of affected applications, and I suspect it would only appear once if tasks for both ARP1 and MCM1 were committed elsewhere (with no "no tasks" line for either application!)I'm guessing it is just a "fake" message for I've got nothing for you, but it doesn't mean that the system has something for another system right at that moment, but maybe it had something for another system in the last "period of time" . Maybe it means I gave a different system a resend within the last 30 minutes ?? My vote is for poor message design. If that is the case, I doubt the message could be made much clearer, confusing though it might be. (Compare with "Too Late" versus "Can't use" on those Darwin validation failures...) Cheers - Al. |
||
|
|
|