Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 46
Posts: 46   Pages: 5   [ Previous Page | 1 2 3 4 5 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 9139 times and has 45 replies Next Thread
marist_university
Advanced Cruncher
USA
Joined: Mar 30, 2005
Post Count: 107
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

I now have 60 long runtime Zika tasks that have had the upload error. The most recent was sent 5/21/16 21:38:57. I'm assuming that's UTC, but it would still be after Uplinger made the size change (I think?).
----------------------------------------

[May 22, 2016 6:04:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Jason1478963
Senior Cruncher
United States
Joined: Sep 18, 2005
Post Count: 295
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

I now have one wu with almost 16 hrs runtime, seems to be progressing with estimated remaining time at 18.12 hrs. on a 2.2Ghz quad core. Are there actually tasks in progress with this long of runtimes or is something going haywire with this? Any thoughts? confused
----------------------------------------

[May 22, 2016 11:33:51 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7846
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

From reading the posts in this thread and looking at some longer WU's I have had, it appears they are packing too many tasks in the WU which in turn is generating the oversize reporting file. I see in the previous post the WU had 174 tasks. The most tasks I have seen in any of the WU's I have processed is 134 (10.43 hours on a xeon 5320 at 1.86ghz - valid) with most having under 50 tasks per WU. It is possible they are yet experimenting with just how many tasks they stick in one WU and still have them validate. Or Uplinger may have to up the size allowance on the output file again to accommodate the bigger WU's. I am just speculating, but I see a correlation here.

Edit:Just had my first one error out: 260 tasks at 20.29 hours
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
----------------------------------------
[Edit 1 times, last edit by Sgt.Joe at May 23, 2016 5:11:26 AM]
[May 23, 2016 12:17:39 AM]   Link   Report threatening or abusive post: please login first  Go to top 
marist_university
Advanced Cruncher
USA
Joined: Mar 30, 2005
Post Count: 107
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

We're still having some error out on upload. Biggest I've seen so far is 349 tasks in a single WU:

task #348 cpu time used 269.265625
[19:36:25] Running task 349,CPU time at start of task 349 was 58792.343750
[19:36:25] ./ZINC48302829.pdbqt size = 25 6 ../../projects/www.worldcommunitygrid.org/171233e7ec9789373bee513616509d43.pdbqt size = 5506 0
[19:38:56] Finished task #349 cpu time used 150.312500
19:38:56 (8864): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
<file_name>ZIKA_000001294_x1nb7_HCVJ4_RNAPol_wRNAand2Mn_chnB_0323_0_r982823721_0</file_name>
<error_code>-131 (file size too big)</error_code>
</file_xfer_error>
----------------------------------------

[May 23, 2016 12:39:56 AM]   Link   Report threatening or abusive post: please login first  Go to top 
nanoprobe
Master Cruncher
Classified
Joined: Aug 29, 2008
Post Count: 2998
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

I now have one wu with almost 16 hrs runtime, seems to be progressing with estimated remaining time at 18.12 hrs. on a 2.2Ghz quad core. Are there actually tasks in progress with this long of runtimes or is something going haywire with this? Any thoughts? confused

I had 1 that ran for 28 hours on my 2.3Ghz. server.
----------------------------------------
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.


[May 23, 2016 12:57:30 AM]   Link   Report threatening or abusive post: please login first  Go to top 
nanoprobe
Master Cruncher
Classified
Joined: Aug 29, 2008
Post Count: 2998
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

I have to laugh at points claimed for these tasks that go error because of the file being too big. 28 hour task, 21 points claimed. 27 hour task, 558 points claimed. biggrin
----------------------------------------
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.


[May 23, 2016 12:51:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Jason1478963
Senior Cruncher
United States
Joined: Sep 18, 2005
Post Count: 295
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks


I had 1 that ran for 28 hours on my 2.3Ghz. server.


Almost 31hrs. now, still going... shock ..93.3% finished with 79 checkpoints already, and 2.1 Hrs. remaining and probably end up an error. crying
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by Jason1478963 at May 23, 2016 2:32:00 PM]
[May 23, 2016 2:31:21 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

You can stop the client, hack the upload file size limit and restart. Who knows you can rescue the task by following https://secure.worldcommunitygrid.org/forums/wcg/viewpostinthread?post=465986

Specifically, uplinger mentioned he'd doubled the permitted size, do that.

Edit: The <max_nbytes> value is in the client_state.xml. Don't know if it's also in the job slot files somewhere.

Edit2: The respective section for a zika task looks like
<file>
<name>ZIKA_000001118_x1nb7_HCVJ4_RNAPol_wRNAand2Mn_chnA_0058_2_r1649271668_0</name>
<nbytes>0.000000</nbytes>
<max_nbytes>4194304.000000</max_nbytes>
<status>0</status>
<gzip_when_done/>
<upload_url>https://grid.worldcommunitygrid.org/boinc/wcg...andler</upload_url>
</file>


About 4MB
----------------------------------------
[Edit 2 times, last edit by SekeRob* at May 23, 2016 2:50:49 PM]
[May 23, 2016 2:41:22 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Jason1478963
Senior Cruncher
United States
Joined: Sep 18, 2005
Post Count: 295
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

You can stop the client, hack the upload file size limit and restart. Who knows you can rescue the task by following https://secure.worldcommunitygrid.org/forums/wcg/viewpostinthread?post=465986

Specifically, uplinger mentioned he'd doubled the permitted size, do that.

About 4MB


Thanks Rob, will give that a shot.

EDIT: To post result.

Update: ZIKA_ 000000975_ x1nb7_ HCVJ4_ RNAPol_ wRNAand2Mn_ chnA_ 0056_ 0-- k9a2-3-9550 Valid 5/21/16 15:47:11 5/23/16 19:36:47 32.92 / 32.92 315.2 / 315.2

Not a whole lot of points for 33 hrs runtime, but it sure beats ERROR any day!

----------------------------------------

----------------------------------------
[Edit 2 times, last edit by Jason1478963 at May 23, 2016 8:56:49 PM]
[May 23, 2016 3:07:17 PM]   Link   Report threatening or abusive post: please login first  Go to top 
nanoprobe
Master Cruncher
Classified
Joined: Aug 29, 2008
Post Count: 2998
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

Hopefully the techs can validate the tasks that have already been reported as errors.
----------------------------------------
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.


[May 23, 2016 4:05:08 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 46   Pages: 5   [ Previous Page | 1 2 3 4 5 | Next Page ]
[ Jump to Last Post ]
Post new Thread