Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 8
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 13101 times and has 7 replies Next Thread
TigerLily
Senior Cruncher
Joined: May 26, 2023
Post Count: 280
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
2023-09-28 Update (Server slowness resolved)

Yesterday, we found and resolved an issue that caused our BOINC server's database to slow down considerably. The WCG system uses IBM MQ messaging middleware to propagate information to different components. A filesystem on the database server ran out of storage space, preventing message propagation on that node and introduced delays into certain database updates. Users may have noticed a decrease in the rate of work unit supply, or general server slowness. We apologize for the inconvenience.
[Sep 28, 2023 2:02:39 PM]   Link   Report threatening or abusive post: please login first  Go to top 
wildhagen
Veteran Cruncher
The Netherlands
Joined: Jun 5, 2009
Post Count: 1004
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 2023-09-28 Update (Server slowness resolved)

I still don't get any workunits on any of my machines:

--
28-09-23 16:37:33 | World Community Grid | Tasks are committed to other platforms
--

Does that mean the issue is NOT resolved yet?
[Sep 28, 2023 2:38:16 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Jake1402
Senior Cruncher
USA
Joined: Dec 30, 2005
Post Count: 181
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 2023-09-28 Update (Server slowness resolved)

Not getting any Windows or android work...Linux machines are full with resends
----------------------------------------
Join the Chicago-IL-USA team!
2 AMD FX 8320/AMD R9 270X/Win 10
2 AMD FX 8320/AMD RX 560/Linux Mint 20.3 (both computers DOA)
Intel Pentium G240/Win 10
[Sep 28, 2023 2:50:25 PM]   Link   Report threatening or abusive post: please login first  Go to top 
cz50975
Advanced Cruncher
Joined: Dec 9, 2004
Post Count: 117
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 2023-09-28 Update (Server slowness resolved)

I have still lengthy list of Linux WUs waiting for validation because system not forwarding it for calculation to another wingman even with 5 days delay.
Here is one example
https://www.worldcommunitygrid.org/contribution/workunit/380104729
[Sep 28, 2023 4:32:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 2023-09-28 Update (Server slowness resolved)

Well, the "slowmess" issue with the web site aside (not sure why nobody noticed a file system running out of drive space before confused , that is unrelated to a firmware upgrade), it is rather depressing that there still is no word as to why there are no WUs in general, beside apparently resends on Linux (and macOS, going by my MacBook).

And the next weekend is approaching fast... sad

Ralf
[Sep 28, 2023 7:36:17 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Paul Schlaffer
Senior Cruncher
USA
Joined: Jun 12, 2005
Post Count: 278
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 2023-09-28 Update (Server slowness resolved)

Folks, it always takes time for the system to catch up after an outage, as the demand is high with everyone hitting it at once. It will catch up, give it time. It wasn't until this evening when I finally received a full complement of work.
----------------------------------------
“Where an excess of power prevails, property of no sort is duly respected. No man is safe in his opinions, his person, his faculties, or his possessions.” – James Madison (1792)
[Sep 29, 2023 1:31:17 AM]   Link   Report threatening or abusive post: please login first  Go to top 
bfmorse
Senior Cruncher
US
Joined: Jul 26, 2009
Post Count: 442
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 2023-09-28 Update (Server slowness resolved)

TigerLily,

Thanks for those details as they are always appreciated.

That information helps us to understand the system a little better. But, more importantly, gives your IT group additional data to fill in the system processes and functions' flow chart with more details! Which is an important resource when the system is not performing as expected.

Keep up the good work!
[Sep 29, 2023 5:35:48 AM]   Link   Report threatening or abusive post: please login first  Go to top 
as1981
Advanced Cruncher
Joined: Dec 3, 2006
Post Count: 51
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 2023-09-28 Update (Server slowness resolved)

Yesterday, we found and resolved an issue that caused our BOINC server's database to slow down considerably. The WCG system uses IBM MQ messaging middleware to propagate information to different components. A filesystem on the database server ran out of storage space, preventing message propagation on that node and introduced delays into certain database updates. Users may have noticed a decrease in the rate of work unit supply, or general server slowness. We apologize for the inconvenience.


Thanks for the information. Some will disagree with me but it looks like issues are getting identified and fixed quicker than in the past. I say that as a positive comment about the situation now and not a criticism of the past.
[Oct 2, 2023 5:02:08 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread