Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 567
Posts: 567   Pages: 57   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 42045 times and has 566 replies Next Thread
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 1316
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

New entry on the Operational Status page...
September 25, 2025
BOINC scheduler and uploads are projected to be up Monday, September 29th, 2025 after a final weekend sprint to test the new deployment strategy for increased performance, event driven horizontal scaling, and reduced load on the BOINC database.
Not as soon as some of us would have liked, but it sounds as if they've changed quite a lot of stuff (as hinted at in earlier Operational Status items!)

Cheers - Al.
[Sep 26, 2025 2:41:58 AM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 1316
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

That post by Occam made some valid points but also (accidentally?) highlighted the possible issues when someone misconstrues something they've found. As an example, mentioned in that post:
Somebody on their own found out that Nibi is down until Sept 26
As has been pointed out in response to more than one poster of that information, the source of the information (https://status.alliancecan.ca/) explicitly mentioned that it didn't apply to the cloud services, so wasn't likely to contribute any extra delay.

Another recent example was that "we are back online" message on 17th September -- I understood it to mean "our Web presence is back" but a lot of folks took it to mean "everything is back" (with unsurprising consequences...)

Avoiding such confusions, along with taking care to make a distinction between fact and opinion, can make information provision problematic. That's one reason I'm a firm believer in the fact that reliable communication requires time and effort. It can take longer to make something concise and unambiguous[*1]...

As for trying to ensure that information is easy to find, that's what the Announcements and Sticky Threads sections were intended for, although the Beta Testing Forum showed an alternative approach, involving a read-only thread with details of each new Beta test and a recommended reply thread for user feedback. A "locked thread and reply thread" strategy allows the information provider(s) to keep adding to what they've passed on without parts of it disappearing in the welter of user responses!

(Unfortunately, they didn't follow that plan for the MAM1 Betas, so the user responses were scattered all over the place at first.)

It is to be hoped that when there are less problems to be dealt with, the WCG folks will have a chance to consider this issue.

Cheers - Al.

*1 -- "I have made this letter longer than usual because I lack the time to make it shorter ..." [approximate translation of a Blaise Pascal quote]
[Sep 26, 2025 3:59:15 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 1293
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

I'm looking forward to Monday. I'm expecting that with all of us trying to upload and download WUs that there may be some "traffic jam" type of slowdowns and errors that will clear on their own with time. Just expect it and be patient.

We wouldn't be so vocal about the issues if we didn't care so much, so I'm looking forward to our energy being put into the crunching and personal progress and/or project progress reports. I really really want to thank the tech team for all their hard work on an unexpected migration project.

Thank you to all of you who hunted down the latest info posted in various place, or discovered from looking at your own system and scripts and brought it back to this thread.

I think Al has made some good points on communication, and I really resonate with the line "It is to be hoped that when there are less problems to be dealt with, the WCG folks will have a chance to consider this issue."

Have a great backup project weekend, and I'll see you all here on Monday.
[Sep 26, 2025 5:53:29 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TLD
Veteran Cruncher
USA
Joined: Jul 22, 2005
Post Count: 856
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Thank you Unixchick for creating and maintaining this thread.
Its the easiest place to find the communications and updates from WCG without having to go through dozens of posts to find anything.
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by TLD at Sep 26, 2025 7:14:03 PM]
[Sep 26, 2025 7:13:15 PM]   Link   Report threatening or abusive post: please login first  Go to top 
bfmorse
Senior Cruncher
US
Joined: Jul 26, 2009
Post Count: 442
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

No change:
• 10/1 to 10/4 - due dates for WU’s,
• Maintenance runs on GLOBAL STATISTICS and OVERVIEW personal devices have not been run since 8/31/25 00:06:03 (UTC) - before WCG’s move to Nibi Cloud from Graham.

I would suspect (pure conjecture) that until those maintenance tasks have been run, I expect no movement of Work Units (WU’s)

YES, I want to resume crunching. But i still need to be patient!
[Sep 29, 2025 8:20:00 PM]   Link   Report threatening or abusive post: please login first  Go to top 
D_S_Spence
Advanced Cruncher
Canada
Joined: Jan 5, 2017
Post Count: 118
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

WUs that were formerly uploading have now changed to status "Ready to report", so it looks like WCG did accept some data today unless I have misremember or hallucinated something. :) I am only looking at my Windows cruncher now and maybe it was the Linux one that had a bunch of completed WUs that had not uploaded... But I think that both of them had some to go.
[Sep 29, 2025 8:39:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

WUs that were formerly uploading have now changed to status "Ready to report", so it looks like WCG did accept some data today unless I have misremember or hallucinated something. :) I am only looking at my Windows cruncher now and maybe it was the Linux one that had a bunch of completed WUs that had not uploaded... But I think that both of them had some to go.
I just checked and nothing has moved so far, nothing has been uploading and nothing have been able to report. Still everything as it was on August 30th... sad


Ralf
[Sep 29, 2025 9:13:20 PM]   Link   Report threatening or abusive post: please login first  Go to top 
D_S_Spence
Advanced Cruncher
Canada
Joined: Jan 5, 2017
Post Count: 118
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

I just checked and nothing has moved so far, nothing has been uploading and nothing have been able to report. Still everything as it was on August 30th... sad


Oh. I am probably mistaken then. Just wishful thinking. I will check on my Linux machine later.
[Sep 29, 2025 9:45:20 PM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 1316
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

I think the last time the due dates for "In Progress" tasks were boosted was several days ago (when Adri posted about it...) -- I've just checked non-reported tasks for my wingmen and my own systems before posting this...

Assuming I'm seeing the live database rather than an older version, some of my wingmen on older tasks seem to have due dates on 2025-09-29, so it looks as if yet another boost might be needed for some tasks before they turn things back on again...

That said, more recent tasks (such as those I didn't manage to return on 2025-08-30) already have due dates on 2025-10-03 or 2025-10-04, so not every task is in danger if there isn't another boost...

Of course, if the APIs and web site are still looking at an old database, the above may not apply :-)

Ah well -- there's always tomorrow (I hope)...

Cheers - Al.
[Sep 29, 2025 10:50:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Taurus Oldbull
Advanced Cruncher
US
Joined: Nov 26, 2020
Post Count: 59
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

The continuing WCG delay may be related to the unplanned outage of Nibi that occurred after the multi-day planned outage:

https://status.alliancecan.ca/system/Nibi
https://status.alliancecan.ca/view_incident?incident=1431

---------------
Created by Kaizaad Bilimorya on 2025-09-29 12:22 PM PDT

Scheduler problem - Problème d'ordonnanceur

Summary

After the outage, problems related to Slurm and MPI are occurring (eg: "Incompatible plugin version"). We are working to fix these issues and will avoid starting new jobs until they are solved.

Updated by Kaizaad Bilimorya on 2025-09-29 3:23 PM PDT
---------------
[Sep 29, 2025 11:41:15 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 567   Pages: 57   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread