World Community Grid - View Thread - CEP Uploads timing out (May 2) (resolved)

World Community Grid Forums

Category: Completed Research

Forum: The Clean Energy Project - Phase 2 Forum

Thread: CEP Uploads timing out (May 2) (resolved)

Quick Go »

No member browsing this thread

Thread Status: Active
Total posts in this thread: 78

[ ]

Author

This topic has been viewed 8528 times and has 77 replies

softstag
Cruncher
Joined: Feb 26, 2009
Post Count: 16
Status: Offline
Project Badges:

180 day badge for Nutritious Rice for the World

180 day badge for The Clean Energy Project

5 year badge for The Clean Energy Project - Phase 2

45 day badge for Computing for Sustainable Water


Re: CEP Uploads timing out (May 2)

Maybe I've just been lucky. 2 CEP units concurrently uploading as I type...

[May 3, 2012 2:45:39 PM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: CEP Uploads timing out (May 2)

Nothing more here. Everything is stuck to my disk and nothing wants to upload...

[May 3, 2012 2:46:38 PM]

knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:

180 day badge for Human Proteome Folding

90 day badge for Human Proteome Folding - Phase 2

45 day badge for Help Cure Muscular Dystrophy - Phase 2

90 day badge for Computing for Clean Water

14 day badge for Uncovering Genome Mysteries

45 day badge for Outsmart Ebola Together

180 day badge for FightAIDS@Home - Phase 2

1 year badge for Microbiome Immunity Project

1 year badge for Africa Rainfall Project

180 day badge for OpenPandemics - COVID-19


Re: CEP Uploads timing out (May 2)

We are working with the Harvard team to resolve this issue. There are actually two servers that support uploading for Harvard and one of them is not reachable at the moment. We are using 'round robin dns' for them. This is why you will sometimes have success and sometimes fail.

So far it appears that the server is functioning properly, but the connections to upload files to the server are not reaching the server. This suggests a networking issue. The Harvard IT support staff is working on the issue.

[May 3, 2012 2:48:45 PM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: CEP Uploads timing out (May 2)

softstag,

You can specify in the cc_config.xml how many can be uploaded/downloaded concurrently. Setting it to 1 gives greatest per-task/result file throughput, but I prefer 3 as typically I don't have more than 2 CEP2 in a waiting to upload state, leaving one thread for the none _4 result files to flush out quickly. Whatever suites one best. :D

--//--

P.S. Here are the 2 <options> that can be set:

<max_file_xfers>N</max_file_xfers>
    Maximum number of simultaneous file transfers (default 8). 
<max_file_xfers_per_project>N</max_file_xfers_per_project>
    Maximum number of simultaneous file transfers per project (default 2).

edit: And thanks Kevin for the update.

----------------------------------------
[Edit 1 times, last edit by Former Member at May 3, 2012 2:54:48 PM]

[May 3, 2012 2:53:05 PM]

RCC_Survivor
Veteran Cruncher
USA
Joined: Apr 28, 2007
Post Count: 1337
Status: Offline
Project Badges:

2 year badge for Human Proteome Folding - Phase 2

45 day badge for Help Cure Muscular Dystrophy

90 day badge for Discovering Dengue Drugs - Together

90 day badge for Nutritious Rice for the World

14 day badge for The Clean Energy Project

5 year badge for Help Fight Childhood Cancer

14 day badge for Influenza Antiviral Drug Search

2 year badge for Help Cure Muscular Dystrophy - Phase 2

14 day badge for Discovering Dengue Drugs - Together - Phase 2

2 year badge for The Clean Energy Project - Phase 2

2 year badge for Computing for Clean Water

2 year badge for Drug Search for Leishmaniasis

2 year badge for GO Fight Against Malaria

2 year badge for Computing for Sustainable Water

100 year badge for Mapping Cancer Markers

5 year badge for Uncovering Genome Mysteries

10 year badge for Outsmart Ebola Together

10 year badge for FightAIDS@Home - Phase 2

10 year badge for Smash Childhood Cancer

10 year badge for Microbiome Immunity Project

2 year badge for Africa Rainfall Project

20 year badge for OpenPandemics - COVID-19


Re: CEP Uploads timing out (May 2)

CEP2 is now uploading.

----------------------------------------

Be kinder than necessary, for everyone you meet is fighting some battle.

Please join the team The survivors hugs

Bilateral Renal, Melanoma, and Squamous Cell cancers

[May 3, 2012 3:06:22 PM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: CEP Uploads timing out (May 2)

As per the post by knreed, 3 up, you have a round-robin 50 percent chance ATM of succeeding. :D

(Noon stats of just over 1 year validated, suggest there's a bunch of extra gigabytes to get through in the coming hours).

--//--

[May 3, 2012 3:11:11 PM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: CEP Uploads timing out (May 2)

There are actually two servers that support uploading for Harvard and one of them is not reachable at the moment. We are using 'round robin dns' for them. This is why you will sometimes have success and sometimes fail.

To satisfy my curiosity, please, why is it only the large files that have failed to start uploading? If the DNS is resolved (with a 50% chance of success) at the start of each file upload, then I would have expected to see several small files also waiting.

[May 3, 2012 3:24:21 PM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: CEP Uploads timing out (May 2)

Working for me too.

[May 3, 2012 3:25:49 PM]

TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:

10 year badge for Help Fight Childhood Cancer

200 year badge for Mapping Cancer Markers

50 year badge for Outsmart Ebola Together

20 year badge for FightAIDS@Home - Phase 2

50 year badge for Smash Childhood Cancer

50 year badge for Microbiome Immunity Project

5 year badge for Africa Rainfall Project

100 year badge for OpenPandemics - COVID-19


Re: CEP Uploads timing out (May 2)

The 50:50 chance of the upload succeeding is rather optimistic... sad

My Mac mysteriously uploaded the last finished WU fine, not getting a new one though, probably as another WU still can't connect...

And on the two other hosts, one has two WUs now still in uploading state, the other one a single one, with the second WU finishing shortly...

So nothing is really "resolved" from my POV, let's see if something changes in the next couple of hours...

Ralf

[May 3, 2012 3:29:27 PM]