| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Support
Forum: Website Support
Thread: Downloads seem to go on forever |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 15
|
|
| Author |
|
|
robertmiles
Senior Cruncher US Joined: Apr 16, 2008 Post Count: 445 Status: Offline Project Badges: 
|
I had 13 tasks partially downloaded for hours, with all of them waiting for file mcm1.dataset-sarc1.txt to download so they could start running.
I did a Retry Now, and it finally downloaded. An idea to try - the server can change its copy of the deadline time, but it cannot change the client's copy. Is the server able to detect when the client has downloaded every input file needed for a task? If so, why not have the server change its copy of the deadline to a new time based on when the last input file finished downloading, rather than the original deadline based on when the client was sent the list of files to download? This would decrease the number of downloads that turn out to be useless because at least one of the tasks for the workunit could not download all of the input files before the original deadline. Note that you'll need some deadline on how long the clients can keep trying to download the input files. |
||
|
|
Dark Angel
Veteran Cruncher Australia Joined: Nov 11, 2005 Post Count: 728 Status: Offline Project Badges: 
|
So are Krembil going to acknowledge the problem?
---------------------------------------- Currently being moderated under false pretences |
||
|
|
Cyclops
Senior Cruncher Joined: Jun 13, 2022 Post Count: 295 Status: Offline |
So are Krembil going to acknowledge the problem? The team is aware of the problem and working on it right now. |
||
|
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 1317 Status: Offline Project Badges:
|
@robertmiles
An idea to try - the server can change its copy of the deadline time, but it cannot change the client's copy. Is the server able to detect when the client has downloaded every input file needed for a task? A similar question was answered in a thread over in the Africa Rainfall Project forum... The key aspect is that it needs an actual error in a download for the client to notify the server (as part of reporting the task as failed); not unreasonably, download retries are not [usually] seen as errors :-) Sadly, a lot of nice ideas aren't likely to happen because of the amount of effort that would actually be required to implement them -- packing up OPN1/OPNG files is another example of this :-( Cheers - Al. |
||
|
|
bekopharm
Cruncher Joined: Nov 17, 2011 Post Count: 3 Status: Offline Project Badges: 
|
"transient HTTP error" all over the board here.
Kinda sucks. It's getting cold in my totally not isolated office and crunching for WCG is kinda my autum/spring strategy to not waste required heat "totally" before I finally move over to an isolated room over the wintertime 😩 |
||
|
|
|