Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 
World Community Grid Forums
  Category: Support
  Forum: Website Support
  Thread: transient HTTP error since about 08:45 UTC - cleared around 10:00 UTC

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 25
Posts: 25   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 3833 times and has 24 replies Next Thread
TonyEllis
Senior Cruncher
Australia
Joined: Jul 9, 2008
Post Count: 254
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: transient HTTP error since about 08:45 UTC
Checking... yes - experienced here also as expected from previous append
08:00 23 Feb in example log below is Australia AEDT (21:00 UTC 22 Feb)

... clipped
23-Feb-2019 08:07:30 [World Community Grid] Computation for task HST1_301154_000028_AC0003_T300_F00028_S00003_0 finished
23-Feb-2019 08:07:37 [World Community Grid] Starting task HST1_301504_000095_KC0008_T325_F00096_S00003_0
23-Feb-2019 08:07:38 [World Community Grid] Started upload of HST1_301154_000028_AC0003_T300_F00028_S00003_0_r645941505_0
23-Feb-2019 08:07:38 [World Community Grid] Started upload of HST1_301154_000028_AC0003_T300_F00028_S00003_0_r645941505_1
23-Feb-2019 08:07:41 [World Community Grid] Temporarily failed upload of HST1_301154_000028_AC0003_T300_F00028_S00003_0_r645941505_0: transient HTTP error
23-Feb-2019 08:07:41 [World Community Grid] Backing off 00:03:53 on upload of HST1_301154_000028_AC0003_T300_F00028_S00003_0_r645941505_0
23-Feb-2019 08:07:41 [World Community Grid] Temporarily failed upload of HST1_301154_000028_AC0003_T300_F00028_S00003_0_r645941505_1: transient HTTP error
... clipped

----------------------------------------
Run Time Stats https://grassmere-productions.no-ip.biz/
[Feb 22, 2019 9:49:15 PM]   Link   Report threatening or abusive post: please login first  Go to top 
PMH_UK
Veteran Cruncher
UK
Joined: Apr 26, 2007
Post Count: 759
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: transient HTTP error since about 08:45 UTC
Just checked and a few HTTP and checksum errors in the logs:

8NUC

32866 World Community Grid 22/02/2019 13:08:51 Started upload of ZIKA_000396758_x5gzn_ZIKV_E-antibody_0723_1_r198237121_0
32867 World Community Grid 22/02/2019 13:08:54 Temporarily failed upload of ZIKA_000396758_x5gzn_ZIKV_E-antibody_0723_1_r198237121_0: transient HTTP error
32868 World Community Grid 22/02/2019 13:08:54 Backing off 00:02:33 on upload of ZIKA_000396758_x5gzn_ZIKV_E-antibody_0723_1_r198237121_0
32869 World Community Grid 22/02/2019 13:11:28 Started upload of ZIKA_000396758_x5gzn_ZIKV_E-antibody_0723_1_r198237121_0
32870 World Community Grid 22/02/2019 13:11:31 Temporarily failed upload of ZIKA_000396758_x5gzn_ZIKV_E-antibody_0723_1_r198237121_0: transient HTTP error
32871 World Community Grid 22/02/2019 13:11:31 Backing off 00:05:21 on upload of ZIKA_000396758_x5gzn_ZIKV_E-antibody_0723_1_r198237121_0
32872 World Community Grid 22/02/2019 13:16:53 Started upload of ZIKA_000396758_x5gzn_ZIKV_E-antibody_0723_1_r198237121_0
32873 World Community Grid 22/02/2019 13:17:00 Finished upload of ZIKA_000396758_x5gzn_ZIKV_E-antibody_0723_1_r198237121_0


E744

360 World Community Grid 22/02/2019 20:40:49 Started upload of ZIKA_000397051_x5gzn_ZIKV_E-antibody_0199_0_r721653751_0
361 World Community Grid 22/02/2019 20:40:52 Temporarily failed upload of ZIKA_000397051_x5gzn_ZIKV_E-antibody_0199_0_r721653751_0: transient HTTP error
362 World Community Grid 22/02/2019 20:40:52 Backing off 00:03:55 on upload of ZIKA_000397051_x5gzn_ZIKV_E-antibody_0199_0_r721653751_0
363 World Community Grid 22/02/2019 20:44:48 Started upload of ZIKA_000397051_x5gzn_ZIKV_E-antibody_0199_0_r721653751_0
364 World Community Grid 22/02/2019 20:44:51 Temporarily failed upload of ZIKA_000397051_x5gzn_ZIKV_E-antibody_0199_0_r721653751_0: transient HTTP error
365 World Community Grid 22/02/2019 20:44:51 Backing off 00:04:47 on upload of ZIKA_000397051_x5gzn_ZIKV_E-antibody_0199_0_r721653751_0
366 World Community Grid 22/02/2019 20:49:39 Started upload of ZIKA_000397051_x5gzn_ZIKV_E-antibody_0199_0_r721653751_0
367 World Community Grid 22/02/2019 20:49:42 Temporarily failed upload of ZIKA_000397051_x5gzn_ZIKV_E-antibody_0199_0_r721653751_0: transient HTTP error
368 World Community Grid 22/02/2019 20:49:42 Backing off 00:12:41 on upload of ZIKA_000397051_x5gzn_ZIKV_E-antibody_0199_0_r721653751_0
377 World Community Grid 22/02/2019 20:58:26 Started upload of ZIKA_000397164_x5gzn_ZIKV_E-antibody_0311_0_r328121627_0
378 World Community Grid 22/02/2019 20:58:29 Temporarily failed upload of ZIKA_000397164_x5gzn_ZIKV_E-antibody_0311_0_r328121627_0: transient HTTP error
379 World Community Grid 22/02/2019 20:58:29 Backing off 00:02:25 on upload of ZIKA_000397164_x5gzn_ZIKV_E-antibody_0311_0_r328121627_0
389 World Community Grid 22/02/2019 21:25:28 Started upload of ZIKA_000397051_x5gzn_ZIKV_E-antibody_0199_0_r721653751_0
390 World Community Grid 22/02/2019 21:25:28 Started upload of ZIKA_000397164_x5gzn_ZIKV_E-antibody_0311_0_r328121627_0
391 World Community Grid 22/02/2019 21:25:37 Finished upload of ZIKA_000397051_x5gzn_ZIKV_E-antibody_0199_0_r721653751_0
392 World Community Grid 22/02/2019 21:25:38 Finished upload of ZIKA_000397164_x5gzn_ZIKV_E-antibody_0311_0_r328121627_0


Lenovo1

8112 World Community Grid 21/02/2019 12:54:39 Started upload of MIP1_00163316_0973_0_r288060264_0
8113 World Community Grid 21/02/2019 12:54:40 Temporarily failed upload of MIP1_00163316_0973_0_r288060264_0: transient HTTP error
8114 World Community Grid 21/02/2019 12:54:40 Backing off 00:02:27 on upload of MIP1_00163316_0973_0_r288060264_0
8115 World Community Grid 21/02/2019 12:57:08 Started upload of MIP1_00163316_0973_0_r288060264_0
8116 World Community Grid 21/02/2019 12:57:10 Temporarily failed upload of MIP1_00163316_0973_0_r288060264_0: transient HTTP error
8117 World Community Grid 21/02/2019 12:57:10 Backing off 00:04:49 on upload of MIP1_00163316_0973_0_r288060264_0
8118 World Community Grid 21/02/2019 12:57:13 Computation for task MIP1_00163346_2287_0 finished
8119 World Community Grid 21/02/2019 12:57:13 Starting task MIP1_00163527_2487_0
8120 World Community Grid 21/02/2019 12:57:15 Started upload of MIP1_00163346_2287_0_r703527611_0
8121 World Community Grid 21/02/2019 12:57:16 Temporarily failed upload of MIP1_00163346_2287_0_r703527611_0: transient HTTP error
8122 World Community Grid 21/02/2019 12:57:16 Backing off 00:02:59 on upload of MIP1_00163346_2287_0_r703527611_0
8130 World Community Grid 21/02/2019 13:05:46 Started upload of MIP1_00163316_0973_0_r288060264_0
8131 World Community Grid 21/02/2019 13:05:46 Started upload of MIP1_00163346_2287_0_r703527611_0
8132 World Community Grid 21/02/2019 13:05:51 Finished upload of MIP1_00163316_0973_0_r288060264_0
8133 World Community Grid 21/02/2019 13:05:51 Finished upload of MIP1_00163346_2287_0_r703527611_0
...
8556 World Community Grid 22/02/2019 00:37:23 Started download of mip1.MIP1_00164100.1
8557 World Community Grid 22/02/2019 00:37:23 Started download of mip1.MIP1_00164100.2
8558 World Community Grid 22/02/2019 00:37:32 Temporarily failed download of mip1.MIP1_00164100.1: transient HTTP error
8559 World Community Grid 22/02/2019 00:37:32 Backing off 00:03:33 on download of mip1.MIP1_00164100.1
8560 World Community Grid 22/02/2019 00:37:32 Started download of mip1.MIP1_00164100.flags
8561 22/02/2019 00:37:33 Project communication failed: attempting access to reference site
8562 World Community Grid 22/02/2019 00:37:33 Finished download of mip1.MIP1_00164100.flags
8563 World Community Grid 22/02/2019 00:37:33 Started download of mip1.MIP1_00164100.fasta
8564 22/02/2019 00:37:34 Internet access OK - project servers may be temporarily down.
8565 World Community Grid 22/02/2019 00:37:34 Finished download of mip1.MIP1_00164100.fasta
8566 World Community Grid 22/02/2019 00:37:34 Started download of mip1.MIP1_00164100.psipred_ss2
8567 World Community Grid 22/02/2019 00:37:35 Finished download of mip1.MIP1_00164100.psipred_ss2
8568 World Community Grid 22/02/2019 00:37:35 Started download of mip1.MIP1_00164100.cst
8569 World Community Grid 22/02/2019 00:37:36 Finished download of mip1.MIP1_00164100.cst
8570 World Community Grid 22/02/2019 00:37:39 Finished download of mip1.MIP1_00164100.2
8574 World Community Grid 22/02/2019 00:41:06 Started download of mip1.MIP1_00164100.1
8575 World Community Grid 22/02/2019 00:41:07 Finished download of mip1.MIP1_00164100.1
8576 World Community Grid 22/02/2019 00:41:07 [error] MD5 check failed for mip1.MIP1_00164100.1
8577 World Community Grid 22/02/2019 00:41:07 [error] expected e57cd89b2ebc41a3a65f62318581c5e8, got 0b4323cc489ca5eba2ab24dd45579cf9
8578 World Community Grid 22/02/2019 00:41:07 [error] Checksum or signature error for mip1.MIP1_00164100.1
...
8923 World Community Grid 22/02/2019 11:15:57 Started download of mip1.MIP1_00164161.1
8924 World Community Grid 22/02/2019 11:15:57 Started download of mip1.MIP1_00164161.2
8925 22/02/2019 11:16:02 Project communication failed: attempting access to reference site
8926 World Community Grid 22/02/2019 11:16:02 Temporarily failed download of mip1.MIP1_00164161.1: transient HTTP error
8927 World Community Grid 22/02/2019 11:16:02 Backing off 00:02:34 on download of mip1.MIP1_00164161.1
8928 World Community Grid 22/02/2019 11:16:02 Started download of mip1.MIP1_00164161.flags
8929 22/02/2019 11:16:03 Internet access OK - project servers may be temporarily down.
8930 World Community Grid 22/02/2019 11:16:03 Finished download of mip1.MIP1_00164161.flags
8931 World Community Grid 22/02/2019 11:16:03 Started download of mip1.MIP1_00164161.fasta
8932 World Community Grid 22/02/2019 11:16:04 Finished download of mip1.MIP1_00164161.2
8933 World Community Grid 22/02/2019 11:16:04 Finished download of mip1.MIP1_00164161.fasta
8934 World Community Grid 22/02/2019 11:16:04 Started download of mip1.MIP1_00164161.psipred_ss2
8935 World Community Grid 22/02/2019 11:16:04 Started download of mip1.MIP1_00164161.cst
8936 World Community Grid 22/02/2019 11:16:05 Finished download of mip1.MIP1_00164161.psipred_ss2
8937 World Community Grid 22/02/2019 11:16:05 Finished download of mip1.MIP1_00164161.cst
8938 World Community Grid 22/02/2019 11:18:37 Started download of mip1.MIP1_00164161.1
8939 World Community Grid 22/02/2019 11:18:39 Finished download of mip1.MIP1_00164161.1
8940 World Community Grid 22/02/2019 11:18:39 [error] MD5 check failed for mip1.MIP1_00164161.1
8941 World Community Grid 22/02/2019 11:18:39 [error] expected d19427458f54fcd4603ed5f6fc23ef4b, got 444febd8847f7be4faef0ab5bcbc54b3
8942 World Community Grid 22/02/2019 11:18:39 [error] Checksum or signature error for mip1.MIP1_00164161.1


Ubuntu_D

10510 World Community Grid 20/02/2019 12:47:04 Started upload of MIP1_00163087_1082_0_r1642063556_0
10511 World Community Grid 20/02/2019 12:47:07 Temporarily failed upload of MIP1_00163087_1082_0_r1642063556_0: transient HTTP error
10512 World Community Grid 20/02/2019 12:47:07 Backing off 00:03:06 on upload of MIP1_00163087_1082_0_r1642063556_0
10513 World Community Grid 20/02/2019 12:50:14 Started upload of MIP1_00163087_1082_0_r1642063556_0
10514 World Community Grid 20/02/2019 12:50:20 Finished upload of MIP1_00163087_1082_0_r1642063556_0
...
12040 World Community Grid 22/02/2019 20:53:14 Started upload of MIP1_00163735_2101_0_r421555730_0
12041 World Community Grid 22/02/2019 20:53:17 Temporarily failed upload of MIP1_00163735_2101_0_r421555730_0: transient HTTP error
12042 World Community Grid 22/02/2019 20:53:17 Backing off 00:03:51 on upload of MIP1_00163735_2101_0_r421555730_0
12043 World Community Grid 22/02/2019 20:57:09 Started upload of MIP1_00163735_2101_0_r421555730_0
12044 World Community Grid 22/02/2019 20:57:12 Temporarily failed upload of MIP1_00163735_2101_0_r421555730_0: transient HTTP error
12045 World Community Grid 22/02/2019 20:57:12 Backing off 00:07:30 on upload of MIP1_00163735_2101_0_r421555730_0
12049 World Community Grid 22/02/2019 21:04:43 Started upload of MIP1_00163735_2101_0_r421555730_0
12050 World Community Grid 22/02/2019 21:04:45 Temporarily failed upload of MIP1_00163735_2101_0_r421555730_0: transient HTTP error
12051 World Community Grid 22/02/2019 21:04:45 Backing off 00:10:48 on upload of MIP1_00163735_2101_0_r421555730_0
12052 World Community Grid 22/02/2019 21:20:19 Started upload of MIP1_00163735_2101_0_r421555730_0
12053 World Community Grid 22/02/2019 21:20:25 Finished upload of MIP1_00163735_2101_0_r421555730_0

Paul.
----------------------------------------
Paul.
[Feb 22, 2019 9:49:49 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: transient HTTP error since about 08:45 UTC
Last week we were applying the latest firmware updates to our servers to deal with the Spectre/Meltdown issues. The firmware updates are a little more intrusive than our normal system updates so we did the updates differently. We have redundancy in our environment so we have been taking servers completely out of service while they get the updates. This worked like it should have for most of last week, but it had been a year since we had really tested the redundancy so on Friday we discovered some items that needed to be fixed. Those issues caused a temporary outage for about 45 minutes. I apologize for not posting about it then. The issue is resolved and we have also addressed the error in our setup so at least we learned something from the event.

Sorry for the inconvenience and thanks for contributing!
[Feb 25, 2019 3:48:42 PM]   Link   Report threatening or abusive post: please login first  Go to top 
cz50975
Advanced Cruncher
Joined: Dec 9, 2004
Post Count: 87
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: transient HTTP error since about 08:45 UTC
Transient HTTP error during donwload from 13:26 UTC today:

31/10/2024 14:26:13 | World Community Grid | Temporarily failed download of MCM1_0227404_7584_MCM1_0227404_7584.txt: transient HTTP error
31/10/2024 14:26:13 | World Community Grid | Backing off 00:02:24 on download of MCM1_0227404_7584_MCM1_0227404_7584.txt
31/10/2024 14:26:13 | World Community Grid | Temporarily failed download of MCM1_0227404_7586_MCM1_0227404_7586.txt: transient HTTP error
31/10/2024 14:26:13 | World Community Grid | Backing off 00:02:42 on download of MCM1_0227404_7586_MCM1_0227404_7586.txt
31/10/2024 14:26:13 | World Community Grid | Started download of MCM1_0227402_7786_MCM1_0227402_7786.txt
31/10/2024 14:26:13 | World Community Grid | Started download of MCM1_0227404_7585_MCM1_0227404_7585.txt
31/10/2024 14:26:18 | World Community Grid | Temporarily failed download of MCM1_0227402_7786_MCM1_0227402_7786.txt: transient HTTP error
31/10/2024 14:26:18 | World Community Grid | Backing off 00:03:44 on download of MCM1_0227402_7786_MCM1_0227402_7786.txt
[Oct 31, 2024 7:35:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1928
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: transient HTTP error since about 08:45 UTC
Transient HTTP error during donwload from 13:26 UTC today:
Yes, that is to be expected once those ARP1 WUs were released into the wild since last night.

This will eventually sort itself out, or if you have the time and determination, you can manually retry those downloads a few times...


Ralf
----------------------------------------
[Oct 31, 2024 9:08:44 PM]   Link   Report threatening or abusive post: please login first  Go to top 
cz50975
Advanced Cruncher
Joined: Dec 9, 2004
Post Count: 87
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: transient HTTP error since about 08:45 UTC
This will eventually sort itself out, or if you have the time and determination, you can manually retry those downloads a few times...


WCG should work without my attention. I discovered this problem randomly (plus another one) just due to short queue of new WUs. Problem solved for this moment by tens of pushes of RETRY button, but that is not solution.
[Oct 31, 2024 9:28:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
puurome
Cruncher
Joined: Jan 6, 2024
Post Count: 20
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: transient HTTP error since about 08:45 UTC
Hi everyone, today 4th November 2024, I'd like to notify the WGC community that I have the same problem notified by other users. Until yesterday, all the WGC WUs had been working like a charm.

Also, my internet connection is working perfectly. On my Boinc client, I have other projects (not WGC) up and running,

Here's a part of my log:
04/11/2024 12:21:38 | World Community Grid | Temporarily failed download of MCM1_0227550_2109_MCM1_0227550_2109.txt: transient HTTP error
04/11/2024 12:21:38 | World Community Grid | Backing off 00:09:02 on download of MCM1_0227550_2109_MCM1_0227550_2109.txt
04/11/2024 12:21:39 | World Community Grid | Temporarily failed download of MCM1_0227550_2108_MCM1_0227550_2108.txt: transient HTTP error
04/11/2024 12:21:39 | World Community Grid | Backing off 00:13:11 on download of MCM1_0227550_2108_MCM1_0227550_2108.txt

Is this happening on your Boinc client or is it only a issue on my side?
Thank you in advance.
----------------------------------------

----------------------------------------
[Edit 2 times, last edit by puurome at Nov 4, 2024 11:47:18 AM]
[Nov 4, 2024 11:34:35 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Falconet
Master Cruncher
Portugal
Joined: Mar 9, 2009
Post Count: 3294
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: transient HTTP error since about 08:45 UTC
It is not just you, puurome.
----------------------------------------


AMD Ryzen 5 1600AF 6C/12T 3.2 GHz - 85W
AMD Ryzen 5 2500U 4C/8T 2.0 GHz - 28W
AMD Ryzen 7 7730U 8C/16T 3.0 GHz
[Nov 4, 2024 11:52:14 AM]   Link   Report threatening or abusive post: please login first  Go to top 
4R3fadTbowP4tD82UVEtidJLdkaB
Cruncher
Joined: Oct 30, 2024
Post Count: 2
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: transient HTTP error since about 08:45 UTC
I'm new to World Community Grid. For the last 4 days nothing runs unless I manually refresh files a bunch of times. I figured it might resolve itself if I let it sit for a day, but nothing downloads without manual intervention.

Downloading does work if there is one active download at a time from WCG. BOINC itself tries to download two files at a time and that's when the http transient error pops up and project backoff pops up. If I could set BOINC to one download at a time I would. My guess is something is configured oddly on the WCG servers that are only allowing one download at a time.

One thing that can be done to reduce the server load is to have each project package itself into a single file instead of sending a handful of files. This reduces the load on the servers because there are a reduction in download requests. If each project sends 8 files, turning that into 1 file would reduce the strain on the server by 8x. (It would not reduce the network bandwidth strain, but that doesn't seem to be the issue here.)
----------------------------------------
[Edit 2 times, last edit by 3FAs5ugdCgMS9mMVYAqMuA5Eg7nr at Nov 5, 2024 2:32:29 PM]
[Nov 5, 2024 2:22:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1928
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: transient HTTP error since about 08:45 UTC
I'm new to World Community Grid. For the last 4 days nothing runs unless I manually refresh files a bunch of times. I figured it might resolve itself if I let it sit for a day, but nothing downloads without manual intervention.

Downloading does work if there is one active download at a time from WCG. BOINC itself tries to download two files at a time and that's when the http transient error pops up and project backoff pops up. If I could set BOINC to one download at a time I would. My guess is something is configured oddly on the WCG servers that are only allowing one download at a time.

One thing that can be done to reduce the server load is to have each project package itself into a single file instead of sending a handful of files. This reduces the load on the servers because there are a reduction in download requests. If each project sends 8 files, turning that into 1 file would reduce the strain on the server by 8x. (It would not reduce the network bandwidth strain, but that doesn't seem to be the issue here.)
Well, that is nothing new in WCG land. And not, you can't just put all download files in one single file for a WU like ARP1.

For one, you might not have noticed that the ARP project, that just got restarted before the weekend, after an almost 2 year hiatus, has HUGE resource demands and might not be suitable for everyone, on every host, to process.
This project has about 10 files for one WU to download, each in the 10-47MB range, for a total of about 130MB. That just is the way how the project is handling the data, nothing you can that easily optimize.
In comparison, the only other WVG project currently running, MCM1, has single WU download files of 912 bytes.

The general issue here exists for years, even before the IBM to Krembilm switch, its just that the later is far more restrained in terms of physical resources and manpower, and thus seems to be more difficult to handle on their side..

My advice would be, at least for now, to make sure you do NOT have ARP1 in your selection of (sub)projects at WCG, only select MCM1, and also make sure that you do not have the "send me work from othe projects" option is also NOT selected. That should ease the "pain" a bit on your end...


Ralf
----------------------------------------
[Nov 5, 2024 3:54:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 25   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread