Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 27
Posts: 27   Pages: 3   [ 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 11973 times and has 26 replies Next Thread
pirogue
Veteran Cruncher
USA
Joined: Dec 8, 2008
Post Count: 685
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
CEP2 Upload server out of disk space? [RESOLVED]

133 World Community Grid 7/12/2010 1:01:24 AM [error] Error reported by file upload server: can't write file /n/nobackup1/cleanenergy/upload/49/E200114_262_A.19.C15H8N2OSe.48.set1d06_0_4: Disk quota exceeded
136 World Community Grid 7/12/2010 1:01:31 AM [error] Error reported by file upload server: can't write file /n/nobackup1/cleanenergy/upload/81/E200114_322_A.19.C15H8N2OSe.92.set1d06_1_4: Disk quota exceeded
----------------------------------------

----------------------------------------
[Edit 2 times, last edit by pirogue at Jul 12, 2010 5:27:56 PM]
[Jul 12, 2010 4:53:20 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Server out of disk space?

Hi,

As of 7:39 AM CEST the error is not logged by my client though it has uploaded several CEP2 since your report. Can you check with a Retry Now in the transfer window plz.

thx

edit: There's 2 hours difference when logging in... the result reports were from before the above fail.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
----------------------------------------
[Edit 1 times, last edit by Sekerob at Jul 12, 2010 6:27:57 AM]
[Jul 12, 2010 5:53:21 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Server out of disk space?

Of course, was not touching wood when typing... same just appeared here:

1289 World Community Grid 12-7-2010 8:15:07 Finished upload of E200120_293_A.19.C15H9NOSeSi.69.1.set1d06_1_1
1290 World Community Grid 12-7-2010 8:17:56 [error] Error reported by file upload server: can't open file /n/nobackup1/cleanenergy/upload/168/E200120_293_A.19.C15H9NOSeSi.69.1.set1d06_1_4: Disk quota exceeded
1291 World Community Grid 12-7-2010 8:17:56 Temporarily failed upload of E200120_293_A.19.C15H9NOSeSi.69.1.set1d06_1_4: transient upload error
1292 World Community Grid 12-7-2010 8:17:56 Backing off 1 min 0 sec on upload of E200120_293_A.19.C15H9NOSeSi.69.1.set1d06_1_4
1293 World Community Grid 12-7-2010 8:18:56 Started upload of E200120_293_A.19.C15H9NOSeSi.69.1.set1d06_1_4
1294 World Community Grid 12-7-2010 8:20:16 [checkpoint_debug] result CMD2_0637-PYRG1A.clustersOccur-2BV1_A.clustersOccur_0_7476_11047_7874_8270_8107_8270_1 checkpointed
1295 World Community Grid 12-7-2010 8:21:43 [error] Error reported by file upload server: can't open file /n/nobackup1/cleanenergy/upload/168/E200120_293_A.19.C15H9NOSeSi.69.1.set1d06_1_4: Disk quota exceeded
1296 World Community Grid 12-7-2010 8:21:43 Temporarily failed upload of E200120_293_A.19.C15H9NOSeSi.69.1.set1d06_1_4: transient upload error
1297 World Community Grid 12-7-2010 8:21:43 Backing off 1 min 0 sec on upload of E200120_293_A.19.C15H9NOSeSi.69.1.set1d06_1_4
1298 World Community Grid 12-7-2010 8:22:44 Started upload of E200120_293_A.19.C15H9NOSeSi.69.1.set1d06_1_4
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jul 12, 2010 6:26:15 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: CEP2 Upload Server out of disk space?

piroque,

Though in the CEP2 forum, can you please put CEP2 in the OP title. Other research results upload fine (to WCG).

I've taken the affected Linux client off-line so it wont persist to upload till coast-clear is advised. Got work till tonight.

AND: It only affects the _4 result files. The other 4 smaller result parts upload fine.

thx
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
----------------------------------------
[Edit 1 times, last edit by Sekerob at Jul 12, 2010 6:49:00 AM]
[Jul 12, 2010 6:36:22 AM]   Link   Report threatening or abusive post: please login first  Go to top 
eviltoad
Senior Cruncher
Australia
Joined: Nov 5, 2005
Post Count: 190
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: CEP2 Upload Server out of disk space?

I've got the same problem too, FWIW. Small files uploaded, large files stuck, error message indicating out of space on server.

Maybe the researchers should rethink the "upload results to non-WCG server" concept. wink
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by eviltoad at Jul 12, 2010 7:55:21 AM]
[Jul 12, 2010 7:51:54 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: CEP2 Upload Server out of disk space?

I'm assuming from the timing (over 10 mins between start of upload and error) that the upload is going ahead full speed until the fail. If so, they really need to stop this problem quickly.

Those who pay for upload bandwidth and/or have monthly quotas could be badly affected by this.
[Jul 12, 2010 8:42:17 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: CEP2 Upload Server out of disk space?

eviltoad,

If suggesting a return of standard upload to WCG, it has a double whammy effect for WCG having to pass the results twice through their pipe... Tonnes of terabytes.

Did put out an alert in the CA forum and when service returns, please let the client handle the resume, so we don't create another choke, hundreds up hundreds trying simultaneously.

I've taken the client off-line again for it seems to be able to upload part _4 to 100% and then backs-off to resume near the beginning and on and on.

thx
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jul 12, 2010 8:52:48 AM]   Link   Report threatening or abusive post: please login first  Go to top 
sk..
Master Cruncher
http://s17.rimg.info/ccb5d62bd3e856cc0d1df9b0ee2f7f6a.gif
Joined: Mar 22, 2007
Post Count: 2324
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: CEP2 Upload Server out of disk space?

Looks like someone needs to get more disk space. This could be user account related (of the technician), as drive space can be limited for accounts in AD, and no doubt similarly in Linux servers.

Mon 12 Jul 2010 08:50:06 AM GMT+5 World Community Grid [error] Error reported by file upload server: can't open file /n/nobackup1/cleanenergy/upload/30b/E200055_208_A.18.C13H7NS2Se2.5.1.set1d06_1_4: Disk quota exceeded
Mon 12 Jul 2010 08:50:06 AM GMT+5 World Community Grid Temporarily failed upload of E200055_208_A.18.C13H7NS2Se2.5.1.set1d06_1_4: transient upload error
Mon 12 Jul 2010 08:50:06 AM GMT+5 World Community Grid Backing off 1 min 0 sec on upload of E200055_208_A.18.C13H7NS2Se2.5.1.set1d06_1_4
Mon 12 Jul 2010 08:50:06 AM GMT+5 World Community Grid Finished upload of E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_0
Mon 12 Jul 2010 08:50:06 AM GMT+5 World Community Grid Started upload of E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_1
Mon 12 Jul 2010 08:50:06 AM GMT+5 World Community Grid Started upload of E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_2
Mon 12 Jul 2010 08:50:17 AM GMT+5 World Community Grid Finished upload of E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_2
Mon 12 Jul 2010 08:50:17 AM GMT+5 World Community Grid Started upload of E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_3
Mon 12 Jul 2010 08:50:18 AM GMT+5 World Community Grid Finished upload of E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_1
Mon 12 Jul 2010 08:50:18 AM GMT+5 World Community Grid Finished upload of E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_3
Mon 12 Jul 2010 08:50:18 AM GMT+5 World Community Grid Started upload of E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_4
...
Mon 12 Jul 2010 09:30:30 AM GMT+5 World Community Grid Started upload of E200055_208_A.18.C13H7NS2Se2.5.1.set1d06_1_4
Mon 12 Jul 2010 09:30:30 AM GMT+5 World Community Grid Started upload of E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_4
Mon 12 Jul 2010 09:37:29 AM GMT+5 World Community Grid [error] Error reported by file upload server: can't open file /n/nobackup1/cleanenergy/upload/1d1/E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_4: Disk quota exceeded
Mon 12 Jul 2010 09:37:29 AM GMT+5 World Community Grid Temporarily failed upload of E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_4: transient upload error
Mon 12 Jul 2010 09:37:29 AM GMT+5 World Community Grid Backing off 1 min 5 sec on upload of E200055_175_A.18.C13H7NOS3.29.3.set1d06_0_4
Mon 12 Jul 2010 09:37:39 AM GMT+5 World Community Grid [error] Error reported by file upload server: can't open file /n/nobackup1/cleanenergy/upload/30b/E200055_208_A.18.C13H7NS2Se2.5.1.set1d06_1_4: Disk quota exceeded
Mon 12 Jul 2010 09:37:39 AM GMT+5 World Community Grid Temporarily failed upload of E200055_208_A.18.C13H7NS2Se2.5.1.set1d06_1_4: transient upload error
Mon 12 Jul 2010 09:37:39 AM GMT+5 World Community Grid Backing off 22 min 3 sec on upload of E200055_208_A.18.C13H7NS2Se2.5.1.set1d06_1_4
Mon 12 Jul 2010 09:38:03 AM GMT+5 Suspending network activity - user request

The problem crunchers have is that the workunits Fully upload, and then we are told there is a drive space error, so they try again after 1min, and again fully upload, an error is reported and Boinc backs off for 2 min...
Im not keen on having my bandwidth eaten up in this way, so I suspended network activity on my one system that runs CEP2 tasks.
I suggest anyone highly restricted by a 'fair usage ISP policy' or using mobile wireless does the same.
----------------------------------------
[Edit 1 times, last edit by skgiven at Jul 12, 2010 9:13:09 AM]
[Jul 12, 2010 9:08:29 AM]   Link   Report threatening or abusive post: please login first  Go to top 
sk..
Master Cruncher
http://s17.rimg.info/ccb5d62bd3e856cc0d1df9b0ee2f7f6a.gif
Joined: Mar 22, 2007
Post Count: 2324
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: CEP2 Upload Server out of disk space?

In the end I gave up, aborted the tasks and booted to XP.
I only had two tasks waiting to upload, but both had a transfer elapsed time of over an hour (and that is with me using suspend networking).
I run other projects (including GPU tasks) so I could only hold off for so long. Every time I tried to upload and download other tasks, Boinc automatically started to upload the CEP2 tasks (pity you cannot suspend one project from networking). This ground Internet access to a halt and slowed my other projects down far too much when trying to upload. I had to babysit the system to get tasks and not halt the Internet - too much hassle, especially as my CPU Time and Elapsed time were so far out. I’m now mostly running climate prediction tasks on that system.
[Jul 12, 2010 11:24:53 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: CEP2 Upload Server out of disk space?

So much impatience. Those results are 10 days valid, so you should could have booted back when the issue is resolved for a quick clearing, which is likely today.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jul 12, 2010 11:59:40 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 27   Pages: 3   [ 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread