Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 484
Posts: 484   Pages: 49   [ Previous Page | 20 21 22 23 24 25 26 27 28 29 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 939500 times and has 483 replies Next Thread
HutchNYC
Advanced Cruncher
United States
Joined: Nov 27, 2005
Post Count: 97
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New Set of Beta WU's - General System Test, All Sciences

Casual observation it appears that the smaller *.tga and *.zip files which are ~1.5MB and smaller transfer quickly (800+ KBps)....it just seems to choke on the large *.zip 60MB+ files.

No timeouts or retry's necessary....just very slow on the large files.

One of them is at 55+ minutes and is still only averaging 10.53 KBps speed at 51.83% D/L progress.

EDIT: It finally finished without any problems (other than the speed) after about an hour and 26 minutes.
----------------------------------------
----------------------------------------
[Edit 1 times, last edit by HutchNYC at Jul 7, 2011 11:30:53 PM]
[Jul 7, 2011 10:57:27 PM]   Link   Report threatening or abusive post: please login first  Go to top 
chrispwilsonuk
Cruncher
Joined: Jul 5, 2008
Post Count: 6
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New Set of Beta WU's - General System Test, All Sciences

Yes, I've noticed the same thing on both my machines.
e.g. elasped time is 1:29:41 and it's only downloaded 69.24% at 8.71KBps
There are a number of other downloads pending in the Transfer screen, waiting on these big file transfers to complete.
[Jul 7, 2011 11:19:11 PM]   Link   Report threatening or abusive post: please login first  Go to top 
anhhai
Veteran Cruncher
Joined: Mar 22, 2005
Post Count: 839
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New Set of Beta WU's - General System Test, All Sciences

hmm, I am at 78MB each on downloading my 66MB files. not good sign
----------------------------------------

[Jul 7, 2011 11:26:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
kateiacy
Veteran Cruncher
USA
Joined: Jan 23, 2010
Post Count: 1027
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New Set of Beta WU's - General System Test, All Sciences

Same here. In fact, I think the downloads today are way slower than yesterday! (I'm getting from 1.4 KBps to 38 KBps on the big files, so more than an hour download time on each.)

Edit: My "same here" was for slow downloads of large files, not for 78 MB out of 66 MB files. The msg from anhai came in as I was typing mine.
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by kateiacy at Jul 7, 2011 11:56:27 PM]
[Jul 7, 2011 11:29:26 PM]   Link   Report threatening or abusive post: please login first  Go to top 
wchoff
Cruncher
Joined: Nov 17, 2004
Post Count: 35
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New Set of Beta WU's - General System Test, All Sciences

hmm, I am at 78MB each on downloading my 66MB files. not good sign


Same here. I observed both a slow download of beta11.qcaux_v2.zip and now it's at 95.43/66.16 MB.

But at least it's speeding up. tongue
[Jul 7, 2011 11:38:27 PM]   Link   Report threatening or abusive post: please login first  Go to top 
anhhai
Veteran Cruncher
Joined: Mar 22, 2005
Post Count: 839
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New Set of Beta WU's - General System Test, All Sciences

hmm, I am at 78MB each on downloading my 66MB files. not good sign



The finally finished downloading, not sure what was the finale size, but at least it worked
----------------------------------------

[Jul 7, 2011 11:56:53 PM]   Link   Report threatening or abusive post: please login first  Go to top 
wchoff
Cruncher
Joined: Nov 17, 2004
Post Count: 35
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New Set of Beta WU's - General System Test, All Sciences

hmm, I am at 78MB each on downloading my 66MB files. not good sign


Same here. I observed both a slow download of beta11.qcaux_v2.zip and now it's at 95.43/66.16 MB.

But at least it's speeding up. tongue



The download finished eventually. I searched for the file and the search tool listed it as 104MB. I right-clicked to see the properties and they showed 66MB. Maybe Windows doesn't like these kinds of .zip files.

The task has run fine for the first four minutes.
[Jul 8, 2011 12:03:16 AM]   Link   Report threatening or abusive post: please login first  Go to top 
sk..
Master Cruncher
http://s17.rimg.info/ccb5d62bd3e856cc0d1df9b0ee2f7f6a.gif
Joined: Mar 22, 2007
Post Count: 2324
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New Set of Beta WU's - General System Test, All Sciences

When a task fails to upload it starts from the beginning, but the upload volume remains (the MB's uploaded continues from where the task left off, a Boinc thing). So that is why you could upload 78MB or 95MB when the task was only 66MB.

While I don't know what all the considerations are, from the outside looking in, I think that sooner or later WCG will have to introduce download/upload resume, and I did suggest this in the past for CEP2 [call this the annual bump].

I picked up a total of 26 more CEP2 Betas (about 10days worth), all on reasonably quick systems. I guess the techs want to see some positives with respect to the task allocation before moving to a full all projects beta run. So it could be at least 2 days before that happens.

[slightly OT but still Beta and delivery system related]
I was thinking about the communication deferred period that is invoked subsequent to a rejection of new downloads (say when you chose Betas only and there are none available, or just when communications are down server side). I believe the initial delay is 1h, but can extend to 24h after repeated failures.
Would there be a way to modify this with respect to core count; it might be fine for a slow dual-core CPU to delay further WCG communication for 1h, but for a fast 8 or 12 thread system it can cause issues and we are moving closer to mainstream 16thread systems. Perhaps the delay period could take into consideration the core count or even a combination of core count and performance. So for example, 2 cores=an initial 1h delay, 4cores=30min, 8=15min (for 24/7 systems)... If this could be setup, then it could always be adapted in the future as need be. Just something maybe worth thinking about[/ot-ish]

Good luck,
[Jul 8, 2011 12:24:36 AM]   Link   Report threatening or abusive post: please login first  Go to top 
gb077492
Advanced Cruncher
Joined: Dec 24, 2004
Post Count: 96
Status: Offline
Reply to this Post  Reply with Quote 
Re: New Set of Beta WU's - General System Test, All Sciences

Regarding skgiven's "slightly ot" comments:

While one could argue that the main consideration is the size of cache that is set for a machine, I do heartily agree that 24hrs is far too long.
[Jul 8, 2011 12:33:19 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: New Set of Beta WU's - General System Test, All Sciences

Same here. In fact, I think the downloads today are way slower than yesterday! (I'm getting from 1.4 KBps to 38 KBps on the big files, so more than an hour download time on each.)

I've seen much variation. The big files downloaded about 3am (i.e. 12+ hrs ago) took about 15-20 mins. The big files which started downloading after 7am took as much as 70 mins.

BTW, as beta11_qcaux_6.40.zip and beta11.qcaux_v2.zip are identical, I assume the duplicate is there just to put extra strain on the servers (and clients)?
[Jul 8, 2011 5:38:37 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 484   Pages: 49   [ Previous Page | 20 21 22 23 24 25 26 27 28 29 | Next Page ]
[ Jump to Last Post ]
Post new Thread