World Community Grid - View Thread - can not download any new workuint

World Community Grid Forums

Category: Support

Forum: BOINC Agent Support

Thread: can not download any new workuint

Quick Go »

No member browsing this thread

Thread Status: Active
Total posts in this thread: 35

[ ]

Author

This topic has been viewed 3864 times and has 34 replies

uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:

10 year badge for Human Proteome Folding

2 year badge for Human Proteome Folding - Phase 2

45 day badge for Help Cure Muscular Dystrophy

2 year badge for Discovering Dengue Drugs - Together

20 year badge for Nutritious Rice for the World

2 year badge for The Clean Energy Project

5 year badge for Help Fight Childhood Cancer

2 year badge for Influenza Antiviral Drug Search

2 year badge for Help Cure Muscular Dystrophy - Phase 2

2 year badge for Discovering Dengue Drugs - Together - Phase 2

10 year badge for The Clean Energy Project - Phase 2

5 year badge for Computing for Clean Water

10 year badge for Drug Search for Leishmaniasis

20 year badge for GO Fight Against Malaria

2 year badge for Computing for Sustainable Water

50 year badge for Mapping Cancer Markers

50 year badge for Uncovering Genome Mysteries

20 year badge for Outsmart Ebola Together

100 year badge for FightAIDS@Home - Phase 2

20 year badge for Smash Childhood Cancer

50 year badge for Microbiome Immunity Project

10 year badge for Africa Rainfall Project

50 year badge for OpenPandemics - COVID-19


Re: can not download any new workuint

Sorry for the slow response on this, I have been looking into other filesystem issues on our end. I am going to look through my logs to see if I inadvertantly removed "no delete" files from our servers. This would have caused the cdn to remove the files if they don't exist anymore. If this is the case I will put these files back in their proper locations.

From what I can tell you're trying to download this file "faah.x2vg5RTNNRTI.pdbqt.gzb' and it is failing.

Thanks,
-Uplinger

[Nov 19, 2014 4:02:02 AM]

uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:


Re: can not download any new workuint

It is not an issue with an accidental delete from my end. I am logging into the CDN to see what may be the issue there.

Thanks,
-Uplinger

[Nov 19, 2014 4:24:24 AM]

uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:


Re: can not download any new workuint

vmzy, I have checked and it appears that the file is there on both our servers and on the CDN. My initial guess is that a firewall is preventing you from accessing the softlayer cdn servers. I will look to see if there is another method for having your agent download. As you can tell, worldcommunitygrid.org is not blocked, but it appears that the files you are having issues downloading are from the CDN alone.

Thanks,
-Uplinger

[Nov 19, 2014 4:56:49 AM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: can not download any new workuint

We have can't download WU directly for one week long.
T_T

[Nov 21, 2014 9:50:16 AM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: can not download any new workuint

Somewhere there was a post that told to set the direct ip, for testing to avoid the cloud, which involved adding lines to the hosts file. Will have a search.

OK, no alzheimer yet, http://www.worldcommunitygrid.org/forums/wcg/viewpostinthread?post=337211

Try this, noting that since that post the ips could have changed.

[Nov 21, 2014 10:01:05 AM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: can not download any new workuint

Haven't tried the solution suggestion by Lavaflow yet.... but actually I hope there will be a solution that makes things to work automatically again without having to use workarounds.

Anyway today I saw some new information in the logs... "can't resolve hostname".
And I as I have mentioned again I am using a VPN to avoid any nasty Chinese firewalls.... so I doubt a firewall is preventing us to download work units.

I wonder, are we the only 2 persons with this issue in China?? That would surprise me, but I haven't seen any other complaints yet...

21-11-2014 19:04:49 | World Community Grid | Started download of faah.base.00049.dat.gzb
21-11-2014 19:04:50 | World Community Grid | Temporarily failed download of faah.base.00049.dat.gzb: can't resolve hostname
21-11-2014 19:04:50 | World Community Grid | Backing off 00:02:08 on download of faah.base.00049.dat.gzb
21-11-2014 19:04:50 | World Community Grid | Started download of faah.base1.00049.pdbqt.gzb
21-11-2014 19:04:51 | | Internet access OK - project servers may be temporarily down.
21-11-2014 19:04:51 | World Community Grid | Finished download of 457b7e09ee3a789b95283f191484d8e2.dpf.gzb
21-11-2014 19:04:51 | World Community Grid | Temporarily failed download of faah.base1.00049.pdbqt.gzb: can't resolve hostname
21-11-2014 19:04:51 | World Community Grid | Backing off 00:03:52 on download of faah.base1.00049.pdbqt.gzb
21-11-2014 19:04:51 | World Community Grid | Started download of faah.base2.00049.pdbqt.gzb
21-11-2014 19:04:51 | World Community Grid | Started download of faah.wcgrid.00049.gpf.gzb
21-11-2014 19:04:52 | World Community Grid | Temporarily failed download of faah.base2.00049.pdbqt.gzb: can't resolve hostname
21-11-2014 19:04:52 | World Community Grid | Backing off 00:03:29 on download of faah.base2.00049.pdbqt.gzb
21-11-2014 19:04:52 | World Community Grid | Temporarily failed download of faah.wcgrid.00049.gpf.gzb: can't resolve hostname
21-11-2014 19:04:52 | World Community Grid | Backing off 00:03:36 on download of faah.wcgrid.00049.gpf.gzb
21-11-2014 19:04:52 | World Community Grid | Started download of faah.wcgrid.00049.dpf.gzb
21-11-2014 19:04:53 | World Community Grid | Temporarily failed download of faah.wcgrid.00049.dpf.gzb: can't resolve hostname
21-11-2014 19:04:53 | World Community Grid | Backing off 00:03:43 on download of faah.wcgrid.00049.dpf.gzb
21-11-2014 19:04:57 | | Project communication failed: attempting access to reference site
21-11-2014 19:04:59 | | Internet access OK - project servers may be temporarily down.
21-11-2014 19:27:30 | World Community Grid | Started download of mcm1.dataset-17_72_SDG_v1.txt
21-11-2014 19:27:30 | World Community Grid | Started download of fahv.x3KDB-A-AS.pdbqt
21-11-2014 19:27:31 | World Community Grid | Temporarily failed download of mcm1.dataset-17_72_SDG_v1.txt: can't resolve hostname

[Nov 21, 2014 11:46:36 AM]

uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:


Re: can not download any new workuint

I am working on a solution as we speak, it will require testing as it is a major change to how we create work on the server. Basically the boinc server allows us to specify more than one url for a file. So on these files that are considered no delete or sticky, I'm going to add the direct url to our main host. This should allow all agents to automatically try the CDN first, if that fails, then it'll attempt to download directly from our servers. Which from what I can tell is not blocked. I also have a ticket open with our CDN provider to try to resolve this issue as well.

Thanks,
-Uplinger

[Nov 21, 2014 3:39:54 PM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: can not download any new workuint

To paraphrase gene hackman from 'enemy of the state', the software configurability is 'not too stupid after all'. laughing

At last, something being buried for good that kept coming back.

applause

[Nov 21, 2014 4:29:36 PM]

zhouxiaobo
Cruncher
Joined: Dec 24, 2012
Post Count: 1
Status: Offline
Project Badges:

180 day badge for The Clean Energy Project - Phase 2

90 day badge for Uncovering Genome Mysteries

2 year badge for Outsmart Ebola Together

1 year badge for FightAIDS@Home - Phase 2

5 year badge for Microbiome Immunity Project

5 year badge for OpenPandemics - COVID-19


Re: can not download any new workuint

Today the problem seems more serious.I use two different US VPNs to download the datas a few days ago.But I CAN'T download any wu today even if I use the proxy.

Here is the log:
2014.11.24. Monday 22h45m50s | World Community Grid | Temporarily failed download of faah.wcgrid.00007.gpf.gzb: transient HTTP error
2014.11.24. Monday 22h45m50s | World Community Grid | Backing off 00:03:46 on download of faah.wcgrid.00007.gpf.gzb
2014.11.24. Monday 22h45m50s | World Community Grid | Started download of 162f742bf6f519bfaa66b5ce7d471f0c.pdbqt.gzb
2014.11.24. Monday 22h45m53s | World Community Grid | Finished download of 162f742bf6f519bfaa66b5ce7d471f0c.pdbqt.gzb
2014.11.24. Monday 22h45m53s | World Community Grid | Started download of 8eff79888440e50194dcea2e59e8b7ed.dat.gzb
2014.11.24. Monday 22h45m54s | | Project communication failed: attempting access to reference site
2014.11.24. Monday 22h45m54s | World Community Grid | Finished download of 8eff79888440e50194dcea2e59e8b7ed.dat.gzb
2014.11.24. Monday 22h45m54s | World Community Grid | Started download of 8ad756795072dcfe3e247423bef43a78.gpf.gzb
2014.11.24. Monday 22h45m56s | World Community Grid | Finished download of 8ad756795072dcfe3e247423bef43a78.gpf.gzb
2014.11.24. Monday 22h45m56s | World Community Grid | Started download of 6fd1546bc07a362f0b96b19d8720edca.dpf.gzb
2014.11.24. Monday 22h45m57s | | Internet access OK - project servers may be temporarily down.
2014.11.24. Monday 22h45m57s | World Community Grid | Finished download of 6fd1546bc07a362f0b96b19d8720edca.dpf.gzb
2014.11.24. Monday 22h45m57s | World Community Grid | Started download of faah.base.00000.dat.gzb
2014.11.24. Monday 22h46m49s | | Project communication failed: attempting access to reference site
2014.11.24. Monday 22h46m49s | World Community Grid | Temporarily failed download of faah.wcgrid.00007.dpf.gzb: transient HTTP error
2014.11.24. Monday 22h46m49s | World Community Grid | Backing off 00:03:07 on download of faah.wcgrid.00007.dpf.gzb
2014.11.24. Monday 22h46m49s | World Community Grid | Started download of faah.base1.00000.pdbqt.gzb
2014.11.24. Monday 22h46m51s | | Internet access OK - project servers may be temporarily down.

Is there any possible solution to solve this issue?

[Nov 24, 2014 2:52:47 PM]

uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:


Re: can not download any new workuint

There is a possible solution to solve this, however it is taking some time to test. It is a change to a major component of our infrastructure. Thus I am testing it extensively on our alpha site. Things are looking good, I am not working on the test if the first URL does not exist. Basically recreating your error, to see if it'll work. Once that is done, I will be testing the peice that does multiple urls for the application files as well.

I am sorry for these issues, but we will hopefully resolve it soon.

Thanks,
-Uplinger

[Nov 24, 2014 3:35:55 PM]

[ ]