Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 33
Posts: 33   Pages: 4   [ 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 7675 times and has 32 replies Next Thread
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Unexpected Outage

Greetings,

We were unexpectedly taken offline last night and we are in the process of restoring service. The website should be back to normal and we are working on restoring the ability to upload/download work.

We apologize for the inconvenience.

- Kevin
----------------------------------------
[Edit 3 times, last edit by knreed at Sep 8, 2019 4:28:33 PM]
[Sep 8, 2019 1:07:45 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unexpected Outage

In order to restore access to the main filesystem where files are uploaded to and download from we need to run a couple of extra maintenance steps for the cluster.

Due to the size of the fs these commands are likely to take a couple of hours to run.
[Sep 8, 2019 1:47:44 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Unexpected Outage

Ok, is this why I can't upload tasks?
----------------------------------------
[Edit 1 times, last edit by Former Member at Sep 8, 2019 2:12:44 PM]
[Sep 8, 2019 2:12:21 PM]   Link   Report threatening or abusive post: please login first  Go to top 
fufu
Cruncher
Joined: Mar 20, 2006
Post Count: 46
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unexpected Outage

Seems like it.
[Sep 8, 2019 2:14:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
gb009761
Master Cruncher
Scotland
Joined: Apr 6, 2005
Post Count: 3010
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unexpected Outage

Okay - glad to hear that the 'issue' is at WCG's end (not that I like to hear of any 'issues', but at least, as ever, Kevin is 'on it' - thus, it's in the process of being resolved)
----------------------------------------

[Sep 8, 2019 2:19:45 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unexpected Outage

We just finished the bringing the system back online. You should be able to upload/download files and report/be assigned jobs. Thanks for your patience.
[Sep 8, 2019 3:07:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Unexpected Outage

Thanks!
[Sep 8, 2019 3:36:27 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Seoulpowergrid
Veteran Cruncher
Joined: Apr 12, 2013
Post Count: 823
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unexpected Outage

I was able to upload most of the completed on my main machine at home but 4 are stuck; 2 FA@H and 2 Zika, and I am unable to download new WUs.

Error message for FA@H is:
9/9/2019 1:13:01 AM | World Community Grid | [error] Error reported by file upload server: can't open file
9/9/2019 1:13:01 AM | World Community Grid | Temporarily failed upload of FAH2_002331_zinc04738514_000001_000018_141_0_r1799496485_0: transient upload error

Error for Zika is:
9/9/2019 1:14:08 AM | World Community Grid | Started upload of ZIKA_000453426_x5hmz_DENV3_NS5_pol_s3_0687_0_r679791339_0
9/9/2019 1:14:10 AM | World Community Grid | [error] Error reported by file upload server: Server is out of disk space
9/9/2019 1:14:10 AM | World Community Grid | Temporarily failed upload of ZIKA_000453426_x5hmz_DENV3_NS5_pol_s3_0687_0_r679791339_0: transient upload error

When i click the Update button to get new WUs the messages read:
9/9/2019 1:15:04 AM | World Community Grid | Requesting new tasks for CPU
9/9/2019 1:15:06 AM | World Community Grid | Scheduler request failed: HTTP service unavailable

It is 1 AM local time so I am going to run off to bed. Sorry for this issue to be happening on your weekend and thank you for all your work to get everything back up.
----------------------------------------

[Sep 8, 2019 4:16:14 PM]   Link   Report threatening or abusive post: please login first  Go to top 
PMH_UK
Veteran Cruncher
UK
Joined: Apr 26, 2007
Post Count: 786
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unexpected Outage

Similar messages here, appears to be broken again.

Paul.
----------------------------------------
Paul.
[Sep 8, 2019 4:17:26 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sabrina Tarson
Advanced Cruncher
United States
Joined: Jun 27, 2012
Post Count: 149
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unexpected Outage

Can confirm, still having issues uploading.

9/8/2019 11:23:46 AM | World Community Grid | [error] Error reported by file upload server: Server is out of disk space
9/8/2019 11:23:46 AM | World Community Grid | [error] Error reported by file upload server: can't open file
9/8/2019 11:23:46 AM | World Community Grid | Temporarily failed upload of FAH2_002524_zinc02895617_000004_000073_145_0_r2024238033_1: transient upload error
9/8/2019 11:23:46 AM | World Community Grid | Backing off 00:13:12 on upload of FAH2_002524_zinc02895617_000004_000073_145_0_r2024238033_1
9/8/2019 11:23:46 AM | World Community Grid | Temporarily failed upload of FAH2_002459_zinc19794660_000004_000076_148_0_r1202619378_0: transient upload error
9/8/2019 11:23:46 AM | World Community Grid | Backing off 00:15:53 on upload of FAH2_002459_zinc19794660_000004_000076_148_0_r1202619378_0
----------------------------------------
[Sep 8, 2019 4:27:20 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 33   Pages: 4   [ 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread