| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Completed Research
Forum: OpenZika
Thread: Upload error (file too big) on long running/high credit Zika tasks |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 46
|
|
| Author |
|
|
marist_college
Advanced Cruncher USA Joined: Mar 30, 2005 Post Count: 107 Status: Offline Project Badges: 
|
Hopefully the techs can validate the tasks that have already been reported as errors. @Uplinger - is that possible? We have 79 of the long run Zika WUs reporting as errors right now.  |
||
|
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
Does the result upload happen if it's deemed too big? Supposing not, then validation becomes hard to do.
|
||
|
|
marist_college
Advanced Cruncher USA Joined: Mar 30, 2005 Post Count: 107 Status: Offline Project Badges:
|
Does the result upload happen if it's deemed too big? Supposing not, then validation becomes hard to do. Rob, my guess is no. One of the machines that one of these failed on was mine, so I checked the local BOINC log for the error unit: Mon May 23 11:22:32 2016 | World Community Grid | Computation for task ZIKA_000000862_x1nb7_HCVJ4_RNAPol_JustProt_chnB_0323_0 finished Mon May 23 11:22:32 2016 | World Community Grid | Output file ZIKA_000000862_x1nb7_HCVJ4_RNAPol_JustProt_chnB_0323_0_r797619075_0 for task ZIKA_000000862_x1nb7_HCVJ4_RNAPol_JustProt_chnB_0323_0 exceeds size limit. Mon May 23 11:22:32 2016 | World Community Grid | File size: 4396353.000000 bytes. Limit: 4194304.000000 bytes There's no indication that the upload was attempted, so I'm guessing it a) checks size and then b) doesn't even attempt upload if too big. @Uplinger - this was about 200KB too big. Will your change from a couple days ago fix this going forward? Or does it need to be increased further? |
||
|
|
nanoprobe
Master Cruncher Classified Joined: Aug 29, 2008 Post Count: 2998 Status: Offline Project Badges: 
|
If you go to results and look for the error tasks and look at the log there is a larger file showing all the work done. I would assume that had to be uploaded to be there.
----------------------------------------
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.
  |
||
|
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
The log file, but not the result data file would be my reasoning.
|
||
|
|
KerSamson
Master Cruncher Switzerland Joined: Jan 29, 2007 Post Count: 1670 Status: Offline Project Badges: 
|
On my side, until now, only one errored WU (from 550+) because of too big file:
----------------------------------------ZIKA_000001011_x1nb7_HCVJ4_RNAPol_wRNAand2Mn_chnA_0343 (7.52 CPU hours) Cheers, Yves |
||
|
|
uplinger
Former World Community Grid Tech Joined: May 23, 2005 Post Count: 3952 Status: Offline Project Badges: 
|
Does the result upload happen if it's deemed too big? Supposing not, then validation becomes hard to do. Rob, my guess is no. One of the machines that one of these failed on was mine, so I checked the local BOINC log for the error unit: Mon May 23 11:22:32 2016 | World Community Grid | Computation for task ZIKA_000000862_x1nb7_HCVJ4_RNAPol_JustProt_chnB_0323_0 finished Mon May 23 11:22:32 2016 | World Community Grid | Output file ZIKA_000000862_x1nb7_HCVJ4_RNAPol_JustProt_chnB_0323_0_r797619075_0 for task ZIKA_000000862_x1nb7_HCVJ4_RNAPol_JustProt_chnB_0323_0 exceeds size limit. Mon May 23 11:22:32 2016 | World Community Grid | File size: 4396353.000000 bytes. Limit: 4194304.000000 bytes There's no indication that the upload was attempted, so I'm guessing it a) checks size and then b) doesn't even attempt upload if too big. @Uplinger - this was about 200KB too big. Will your change from a couple days ago fix this going forward? Or does it need to be increased further? The change I put in place was to have the file size to to 8MB instead of the 4MB that you show there. The change only worked on new work downloaded after my change. I changed the value in the database, but your client already had the limit of 4MB in it's downloaded definition. I have confirmed that 8MB is what is sent to clients: <file_info> <name>ZIKA_000002357_x3hkw_HCV1a_NS5B_chnB_0322_0_r224056512_0</name> <generated_locally/> <upload_when_present/> <max_nbytes>8388608</max_nbytes> <gzip_when_done/> <url>https://grid.worldcommunitygrid.org/boinc/wcg...pload_handler</url> </file_info> <result> <file_ref> <file_name>ZIKA_000002357_x3hkw_HCV1a_NS5B_chnB_0322_0_r224056512_0</file_name> <open_name>result.out</open_name> </file_ref> </result> If a file is determined to large, then it does not get uploaded to our servers at all. And is reported as an error :( Thanks, -Uplinger |
||
|
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
You can stop the client, hack the upload file size limit and restart. Who knows you can rescue the task by following https://secure.worldcommunitygrid.org/forums/wcg/viewpostinthread?post=465986 Specifically, uplinger mentioned he'd doubled the permitted size, do that. About 4MB Thanks Rob, will give that a shot. EDIT: To post result. Update: ZIKA_ 000000975_ x1nb7_ HCVJ4_ RNAPol_ wRNAand2Mn_ chnA_ 0056_ 0-- k9a2-3-9550 Valid 5/21/16 15:47:11 5/23/16 19:36:47 32.92 / 32.92 315.2 / 315.2 Not a whole lot of points for 33 hrs runtime, but it sure beats ERROR any day! [:grin from ear to ear smiley] |
||
|
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7574 Status: Offline Project Badges:
|
Maybe Uplinger got the problem fixed. At least this one did not go "error". It must be some kind of repair unit, because it starts on task 67 and runs through task 306. Unless of course the stderr file ran out of space and lost the logs of the first 66 tasks. It also must have bumped up against the outlier point ceiling too.
---------------------------------------- ZIKA_ 000000858_ x1nb7_ HCVJ4_ RNAPol_ JustProt_ chnB_ 0338_ 1-- PowerEdge-2950 Pending Validation 5/23/16 02:43:24 5/24/16 12:19:44 26.21 / 26.40 49.5 / 0.0 Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
|
marist_college
Advanced Cruncher USA Joined: Mar 30, 2005 Post Count: 107 Status: Offline Project Badges:
|
The errors have decreased significantly and I can see in the few client_state.xml I checked that <max_nbytes> is now coming through as 8MB for Zika units. Thanks, Uplinger.
---------------------------------------- |
||
|
|
|