Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 46
Posts: 46   Pages: 5   [ Previous Page | 1 2 3 4 5 ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 9136 times and has 45 replies Next Thread
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

Did a quick query to capture the runtime values. It is a nice curve as you would expect.

http://i.imgur.com/dCXBDst.png

Counts on left are results, bottom is hours of runtime, grouped by 10ths of an hour.

Thanks,
-Uplinger
[Jun 2, 2016 8:38:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

Ok, So a few things we have checked.

1. There is a hard limit of 350 jobs per work unit. A majority of the work units run less than that, most below 100. For some reason there is a group of ligands that are estimated incorrectly and have not adjusted in the database that we use to estimate.

2. The file upload limit is being set to the uncompressed file that is sent back. The upload compression is about 1:8 ratio.

With these two things in mind and the fact it was only like 130 work units, I have increased the upload size to 16MB for the time being. This should help us get past these file size issues and get some more datapoints to estimate these batches better. Currently work units are running an estimated 1h 51m, which is pretty good since we are targeting 2 hour run times at the moment.

Thanks,
-Uplinger

Think the small 'understatement' on https://www.worldcommunitygrid.org/help/viewTopic.do?shortName=minimumreq for the upload value could use a little adjustment :O)

OpenZika 2 MB 0.2 MB 0.1 MB

Glad these jobs take 6 to 12 hours on the tablet v.v. the now 16MB upload size limit, else my 4G data plan would be really quickly exhausted [albeit it's 10GB/Month].
----------------------------------------
[Edit 1 times, last edit by SekeRob* at Jun 6, 2016 7:42:48 AM]
[Jun 6, 2016 7:41:20 AM]   Link   Report threatening or abusive post: please login first  Go to top 
dango
Senior Cruncher
Joined: Jul 27, 2009
Post Count: 307
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

Sekerob,

16MB in uncompressed size. every upload was (for me) max 200kb
[Jun 6, 2016 8:11:54 AM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

Ah, still 0.1 or 0.2 ;O) (Does the max 16MB compress to 0.2MB?)

Not too sure who compresses in transmission from Android... no such thing as a transfer window to see, it's the only device I do zika on.
[Jun 6, 2016 8:28:23 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

SekeRob,

I have changed the system requirements as you asked. As for if the Android application uploads it compressed, it does. The compression is done on the fly client side to the server.

Thanks,
-Uplinger
[Jun 8, 2016 3:24:46 PM]   Link   Report threatening or abusive post: please login first  Go to top 
marist_university
Advanced Cruncher
USA
Joined: Mar 30, 2005
Post Count: 107
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Upload error (file too big) on long running/high credit Zika tasks

@Uplinger - FYI, we haven't had any file to big errors since you made the change to 16 MB.
----------------------------------------

[Jun 8, 2016 5:04:08 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 46   Pages: 5   [ Previous Page | 1 2 3 4 5 ]
[ Jump to Last Post ]
Post new Thread