Adri,

That's a repeat of what happened with the [MCM1] assimilators back in early 2024 -- you and I had something to say about it in the "Are all assimilators running?" thread back then!

So it looks as if they might be running 4 feeders (or 4 work generators for MCM1?) and the "0 mod 4" one isn't working. I haven't seen a task for a "0 mod 4" MCM1 WU since about 22:20 on 2025-02-23 and I haven't seen any ARP1 work since about the same time...

I have also seen a couple of tasks where my wingman missed the deadline and returned the NSD error (that WCG doesn't name as such), but no retry was queued. That's more extreme than having retries Waiting to be sent!!! The most recent one was WU 67096596 [MCM1] - initial wingman went NSD (2025-02-24 02:57 UTC) but no retry has been generated at the time of this posting. Please note that it, too, is a "0 mod 4" case, although that may be a coincidence!

I'm not sure, but that failure to generate a retry suggests that perhaps a transitioner backlog had happened, as if that happens all sorts of odd side-effects might show up. The most common one is that properly coded work unit generators[*1] should wait to iterate until they see their most recent previous new work has been "transitioned" (which could take some time!); another may be failure to mark returned task/WU state transitions in a timely fashion (so the failed task doesn't get flagged for a retry, and transitions through the stages of assimilation and purging might be held up...)

All in all, not nice :-(

Cheers - Al.

*1 -- a while ago, MilkyWay had a situation where one of their work generators created millions of WUs, and it took ages to get back to normal. I had a look at what was [allegedly] their generator (which was very customized) and noted that it didn't have the "safety net" code that made it wait if the transitioner was backlogged (which it had been!), so I contacted the person then responsible for the server to let him know. (That was my first code-dive into BOINC server stuff, and I'm glad I don't have to maintain that stuff!)

I so agree Al. I would love to make this thread obsolete. I would love a real status page. They can throttle it to update hourly if the db access is the issue. I'm guessing the small tech team is focused on fixing things and prepping new projects.

I complain about how things could be better, but I try to also remember to be grateful for what we have. A system that functions, and gives us WUs of two projects even if it isn't at the rate we would like. I think it must have been a BIG task to get WCG to run on different hardware, and then to take on the ARP task. I think it is amazing that they have a new project to give us too. Just reminds me that I need to make another monetary donation to the group.

Thanks for the link AgrFan. I had forgotten about the upgrades. This is likely the issue.
Thus WCG is just dealing with the issues they have no control over.

I'm out of WUs at the moment. No ARP, and no MCM. I'm not sure if others are getting MCM as it says "committed to other platforms" so maybe MCMs are going out still ??

Dry on all systems here.

Cheers

That's right, Al, I decided to take another look at that thread and it looks like 25% of the assimilators are down at the moment.

Adri