Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 18
Posts: 18   Pages: 2   [ Previous Page | 1 2 ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 4877 times and has 17 replies Next Thread
DennyInDurham
Cruncher
USA
Joined: Aug 4, 2020
Post Count: 23
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Bandwidth wasted by interrupted WUs downloads

Today it was both uploads and downloads hanging... uploads would get to 100% and then just sit there, then eventually (maybe 5 minutes) timeout and start over from 0.

Overnight every night some download stalls, it stops fetching WUs entirely, and I have to kick start it in the morning.
[Oct 10, 2022 3:07:14 AM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Bandwidth wasted by interrupted WUs downloads

Today it was both uploads and downloads hanging... uploads would get to 100% and then just sit there, then eventually (maybe 5 minutes) timeout and start over from 0.

That's what I saw, too, but it is not the entire story. After dropping to 0 and after reestablishing the connection, they would resume at the point where they got interrupted.
[Oct 10, 2022 8:04:02 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Bandwidth wasted by interrupted WUs downloads

Today it was both uploads and downloads hanging... uploads would get to 100% and then just sit there, then eventually (maybe 5 minutes) timeout and start over from 0.

That's what I saw, too, but it is not the entire story. After dropping to 0 and after reestablishing the connection, they would resume at the point where they got interrupted.
Those upload errors where clearly at a time when someone on Kremibil/WCG's end was working on the system. It was only intermittent on Saturday and I have not seen any hung or deferred download or upload since Sunday morning. Hope that isn't jinxing it again.

Ralf
[Oct 10, 2022 4:52:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
zdnko
Senior Cruncher
Joined: Dec 1, 2005
Post Count: 235
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Bandwidth wasted by interrupted WUs downloads

10/10/2022 17:18:50	Temporarily failed upload of OPNG_0154059_00293_1_r665126149_0: transient HTTP error	
10/10/2022 17:18:50 Backing off 00:03:18 on upload of OPNG_0154059_00293_1_r665126149_0
10/10/2022 17:18:50 Temporarily failed upload of OPNG_0154059_00293_1_r665126149_1: transient HTTP error
10/10/2022 17:18:50 Backing off 00:02:17 on upload of OPNG_0154059_00293_1_r665126149_1

sad
[Oct 10, 2022 6:28:58 PM]   Link   Report threatening or abusive post: please login first  Go to top 
MarkH
Advanced Cruncher
United States of America
Joined: May 16, 2020
Post Count: 66
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Bandwidth wasted by interrupted WUs downloads

Seeing this in the United States as well as of Oct. 10th. I get occasional uploads and downloads without any issue, then suddenly it's like somebody turned the servers to "eternity slow" or Krembil's bandwidth was set to 56K dial-up suddenly. I get project backoffs that even get a 2nd delay clock counting down. I get some that the download timer is clicking merrily way with ZERO download speed or activity. I have screen grabs of those issues, but if Krembil doesn't know it by now, they never will. I have to 'babysit' my uploads and downloads to make sure they happen, but at least I'm running WUs again. SCIENCE!

And on a general note, not aimed at anyone in particular: This is what all of need to keep in mind. It's about the science. Not about us as individuals. Krembil knows they have problems, but we can keep doing our part for all Mankind while they sort it out. Every job we can finish and send back counts. Keep it up. Do not let these frustrations deter you from the goal. Do not flag or fail. Do the best you can personally each day with what we have to work with. Yes, Krembil needs to do better, and yes, I've seen the Facebook posts about outages that seemed to stretch the limits of patience, but some of the replies were even more beyond the limits of reason and judgment. We, the WCG Community, a band of brothers and sisters united by our desire to fight disease, death, and suffering, even of those we may never know or meet, regardless of political or social ideologies, need now more than ever to have Krembil's back, and the researcher's backs, to carry on their good work through the storm. We may be delayed, but never denied. Our friends need us now more than ever in kind words and completed work units. Let us not fail them, and brace ourselves to our duties, and "so bear ourselves that, if the [World Community Grid] and [BOINC] last for a thousand years, men will still say, 'This was their finest hour.'" (Winston Churchill, 1940, altered in brackets).
----------------------------------------
That science of the people, by the people, for the people, shall not perish from the Earth.
[Oct 10, 2022 6:36:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Jean-David Beyer
Senior Cruncher
USA
Joined: Oct 2, 2007
Post Count: 339
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Bandwidth wasted by interrupted WUs downloads

Seeing this in the United States as well as of Oct. 10th. I get occasional uploads and downloads without any issue, then suddenly it's like somebody turned the servers to "eternity slow" or Krembil's bandwidth was set to 56K dial-up suddenly.


It certainly seems that way sometimes. My network connection, with Verizon's FiOS, is 75 megabits/second, and sometimes even a little bit faster. 9,375 kilobytes/second. But yesterday I got big throttling down to 40 to 60 KiloBytes/second (dial-up) speeds with Africa Rainfall Project. Maybe others too, but the others typically send far fewer files per work unit, so I do not notice these problems.
----------------------------------------

[Oct 11, 2022 3:34:12 AM]   Link   Report threatening or abusive post: please login first  Go to top 
KerSamson
Master Cruncher
Switzerland
Joined: Jan 29, 2007
Post Count: 1684
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Bandwidth wasted by interrupted WUs downloads

ARP uploads is going fast >2500 Kb/s
ARP downloads can occur at 30 to 50 Kb/s and take a half eternity.

I have to look again if the situation improve in the next days.
----------------------------------------
[Oct 15, 2022 2:12:12 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Bandwidth wasted by interrupted WUs downloads

ARP uploads is going fast >2500 Kb/s
ARP downloads can occur at 30 to 50 Kb/s and take a half eternity.
Is that as recent as yesterday or even today, Yves? I'm seeing only very fast downloads, like this one from yesterday (with its result in post 677734):

14-Oct-2022 21:22:26 [World Community Grid] Scheduler request completed: got 1 new tasks
14-Oct-2022 21:22:26 [World Community Grid] Project requested delay of 121 seconds
14-Oct-2022 21:22:28 [World Community Grid] Started download of ARP1_0029036_132_ARP1_0029036_132.input
14-Oct-2022 21:22:28 [World Community Grid] Started download of 9dc89559269e57dbff282195421e5799.
14-Oct-2022 21:22:30 [World Community Grid] Finished download of ARP1_0029036_132_ARP1_0029036_132.input
14-Oct-2022 21:22:30 [World Community Grid] Started download of c7e671b4d506b392c085e10f0c38ee6c.
14-Oct-2022 21:22:32 [World Community Grid] Finished download of c7e671b4d506b392c085e10f0c38ee6c.
14-Oct-2022 21:22:32 [World Community Grid] Started download of 8c7daa37f0cd82f1f3392f4b47fcf11b.
14-Oct-2022 21:22:34 [World Community Grid] Finished download of 8c7daa37f0cd82f1f3392f4b47fcf11b.
14-Oct-2022 21:22:34 [World Community Grid] Started download of 08d9636f25ba224591c63d01bf4403b4.
14-Oct-2022 21:22:36 [World Community Grid] Finished download of 08d9636f25ba224591c63d01bf4403b4.
14-Oct-2022 21:22:36 [World Community Grid] Started download of fab83930adc0214030928d54d1208855.7z

(Taken from /var/log/messages)
(Localtime 21:22:00 is 19:22:00 UTC.)
I have to look again if the situation improve in the next days.

Yes, please do, it would mean that there is a big, big, big problem if this is still nerve-racking slow at times.

Adri
[Oct 15, 2022 3:20:55 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 18   Pages: 2   [ Previous Page | 1 2 ]
[ Jump to Last Post ]
Post new Thread