| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Community
Forum: Chat Room
Thread: Project Status (First Post Updated) |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 584
|
|
| Author |
|
|
Hans Sveen
Veteran Cruncher Norge Joined: Feb 18, 2008 Post Count: 990 Status: Offline Project Badges: 
|
Some of my hanging uploads have started to move again, new wus received!
Thanks to Whoever worked the nightshift 😉 |
||
|
|
bfmorse
Senior Cruncher US Joined: Jul 26, 2009 Post Count: 444 Status: Offline Project Badges:
|
For a brief tally of my current MCM WU breakdown:
"In Progress" MCM WU's 2601 items [was 2309] "Pending Validation" MCM WU's5913 items "Valid" MCM WU's 45692 items "Error" MCM WU's30 items I have noticed that although the uploads are struggling, to put it mildly, the systems HAVE been getting additional WU's during this struggle.I have not attempted to count the additional WU's, I merely observed that the listing of WU's on the computers is longer than previous and the log shows successful downloads of additional WU's.. Al is doing a much better job of documenting the issues - Thanks!. |
||
|
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 1320 Status: Offline Project Badges:
|
I gave up on watching things at about 02:00 UTC today, at which point two of my four main systems were at a "too many pending uploads" state (MW@Home standing as beneficiary...)
When I checked in again at about 08:00 I saw Hans Sveen's 06:23 post about uploads moving again so I checked my systems, most of which were in that state where the retry delay was several hours so nothing seemed to have moved. A more detailed check showed that one task from group 2 [126] had cleared at 04:17 whilst another from that group [144] had failed a minute earlier. None of my systems had tried to upload anything else from that group after that... A few attempts to upload tasks from the other group at about 05:40 had failed, but [again] most of my systems had long retry delays so very few actual attempts made! Having done that preview, I used Tools|Retry pending transfers on the three systems with long lists, starting at about 08:25, and doing one system at a time to minimize risk. All cleared out their entire lists; there was only one tiny glitch, where the very last upload it tried from one system took three attempts before it uploaded. It wasn't the last system I processed; the next long list one and the one system with hardly any stalled uploads were both cleared out [without issues] after that! So I second Hans in his thanks to the "night shift"  -- here's hoping that this time the fixes stick!Cheers - Al |
||
|
|
Unixchick
Veteran Cruncher Joined: Apr 16, 2020 Post Count: 1298 Status: Offline Project Badges: 
|
I echo the posts of others in thanking Dylan and any other IT people for working on the weekend and middle of the night to fix these issues.
I hope this is a good week for smushing bugs |
||
|
|
bfmorse
Senior Cruncher US Joined: Jul 26, 2009 Post Count: 444 Status: Offline Project Badges:
|
Unixchick
I concur! I also notice that there are a couple of resends to the MCM test WU's that were issued at 2025-11-03 14:35:35 UTC: MCM1_9999998_965946_2 MCM1_9999998_960933_2 I also noticed other normal MCM1 resends earlier. Which further demonstrates that... .... Progress is being made! AWESOME! |
||
|
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 1320 Status: Offline Project Badges:
|
There appears to have been another brief uploads issue for the main problem group early on 2025-11-04. Fortunately, I didn't have many active tasks from that group, and the problem seemed to resolve itself after about 90 minutes. (First failure at 02:27 UTC; about half a dozen tasks stuck but all cleared around 04:00.)
----------------------------------------It would be interesting to know whether this was a case of "self-healing" or whether it had required manual intervention at the WCG end. There is something odd going on anyway as at around 03:20 UTC the Project Statistics update pages were visible and current, but at 04:15 UTC they were saying "The statistics update will finish in about 192 minutes"... Then suddenly the proper pages reappeared at about 04:30 UTC! Strange... Cheers - Al. [Edit 1 times, last edit by alanb1951 at Nov 4, 2025 4:41:54 AM] |
||
|
|
Hans Sveen
Veteran Cruncher Norge Joined: Feb 18, 2008 Post Count: 990 Status: Offline Project Badges:
|
A nice and new update from dylanht in this thread:
----------------------------------------https://www.worldcommunitygrid.org/forums/wcg/viewpostinthread?post=707175 Thank You again dylanht 👌😍 PS... About MAMBeta:: https://www.worldcommunitygrid.org/forums/wcg/viewpostinthread?post=707176 [Edit 3 times, last edit by Hans Sveen at Nov 4, 2025 6:23:12 PM] |
||
|
|
Unixchick
Veteran Cruncher Joined: Apr 16, 2020 Post Count: 1298 Status: Offline Project Badges:
|
THANK YOU DYLAN
----------------------------------------great updates! Thanks for sharing Hans. I'm putting these links in the first post too. [Edit 1 times, last edit by Unixchick at Nov 4, 2025 6:47:25 PM] |
||
|
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 1320 Status: Offline Project Badges:
|
Further to the updates Hans Sveen mentioned above, there's another one which was mostly about why the stats export wasn't happening yet, but it also explained why we were seeing so many HTTP errors on uploads (but not across the board...)
https://www.worldcommunitygrid.org/forums/wcg/viewpostinthread?post=707168 Cheers - Al. |
||
|
|
Unixchick
Veteran Cruncher Joined: Apr 16, 2020 Post Count: 1298 Status: Offline Project Badges:
|
Thanks for the link Al.
I've added all the Dylan update posts to the first post. let me know if you find more. Thank you Dylan for not only taking the time to not just patch the old leaky system, but to build us a new system that will allow us to do more in the future. Also, big thanks for taking the time to post all the info on the forum. Many of us are tech people who like to know the details, and others just want to know that the system is being maintained and it is worth their cycles. |
||
|
|
|