Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 9
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1745 times and has 8 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Download overruns

I get this too often to ignore. The download Progress column goes to 100% while the File size becomes irrational.

http://postimage.org/image/1pyxjplj8/


One user stated to just reset project. What's the problem?
----------------------------------------
[Edit 1 times, last edit by Former Member at Apr 10, 2011 3:40:17 AM]
[Apr 10, 2011 3:28:14 AM]   Link   Report threatening or abusive post: please login first  Go to top 
z2000
Advanced Cruncher
Joined: Feb 27, 2011
Post Count: 116
Status: Offline
Reply to this Post  Reply with Quote 
Re: Download overruns

Hopefully others know. I haven't seen that yet.
From your image, it looks like the transfer speed is really slow. Are you on wireless internet? The other thing(s) I can think of to ask is

You're not skipping image file verification, are you?
You don't have transfer speed limits checked in manual preferences, right?
Do you have other tasks, projects, or PC programs that might me holding up your internet traffic?

good luck, and I hope others know more about that


[actually, the transfer speed might be ok the way it is, I just noticed mine transfers even slower ( <3K bps at times), even though my internet connection is 100.0M bps)
----------------------------------------

----------------------------------------
[Edit 3 times, last edit by z2000 at Apr 10, 2011 3:56:11 AM]
[Apr 10, 2011 3:46:44 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7846
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Download overruns

I get this too often to ignore. The download Progress column goes to 100% while the File size becomes irrational.

http://postimage.org/image/1pyxjplj8/


One user stated to just reset project. What's the problem?


I have seen this before when there is some catastrophic(?) interruption of the download. I think BOINC loses its place and starts the download over without resetting the counter. On mine they went to almost 150% but everything ended up working fine. To my knowledge it only happened once.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Apr 10, 2011 4:01:35 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Download overruns

+1 Sgt Joe - When your connection gets dropped (most often this it is your ISP and/ or your local PC) BOINC has to recheck the last bits sent when it reconnects and sends more. If this happens a couple of times on the same transfer (especially on small files) you will see what appears to be overruns. You would think Berkeley could fix this in the BOINC agent but they never have.
[Apr 10, 2011 10:47:54 AM]   Link   Report threatening or abusive post: please login first  Go to top 
sk..
Master Cruncher
http://s17.rimg.info/ccb5d62bd3e856cc0d1df9b0ee2f7f6a.gif
Joined: Mar 22, 2007
Post Count: 2324
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Download overruns

With at least some non-WCG Boinc projects upload & downlaod can pickup where they left off when a connection is lost, but at WCG this is not the case. So if your connection to WCG is dropped you have to start the upload/download from scratch. This can result in lots of problems. It wastes bandwidth, might interfere with other online activity, cause bandwidth restrictions to kick in and would probably mess with your chances of getting Beta tasks.
Sometimes stopping and starting the router/restarting your system can help and sometimes replacing your wireless connector does the trick.
[Apr 10, 2011 12:37:12 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Download overruns

Thanks for all replies. I just ran across a script in C which converts DOS to UNIX and the other way around. The problem with the difference in the two is the CR/LF or CR control characters. Some scripts are no problem, yet others are for reasons of printer compatabilities.

I only mention the above as an example of how scripts differ across the cloud of possibilities as no one size fits all

Perhaps it's a simple lack of trapping EOF (end of file) markers or not.

In any case the traffic density is surely a factor as I know the problem is more frequent when the web is loaded with packets and the BW is low.

As a temporary measure, I simply "Abort" the troublesome task since they mostly are very large files (over a MB) and interruptions occur in my dialup (56K) line connection.

Happy crunching!
[Apr 10, 2011 4:26:28 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Download overruns

I checked all the config options you mentioned,and none had to be changed.
[Apr 10, 2011 4:29:55 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Ingleside
Veteran Cruncher
Norway
Joined: Nov 19, 2005
Post Count: 974
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Download overruns

+1 Sgt Joe - When your connection gets dropped (most often this it is your ISP and/ or your local PC) BOINC has to recheck the last bits sent when it reconnects and sends more. If this happens a couple of times on the same transfer (especially on small files) you will see what appears to be overruns. You would think Berkeley could fix this in the BOINC agent but they never have.

If a download is interrupted before finish, the BOINC-client will discard the last 2 KB transferred before saving the file to disk. On next download-try, the client tells the server how much of the file is already present, and the server should only send the remaining part. But, the WCG download-server intentionally overlooks the client-info, and always re-start the download from beginning. Since client isn't aware of this, the download will continue past 100%. After getting the whole file in a single download-attempt, the client will correctly discard the previously-downloaded portion of the file and use only the "correct" file.

While download-resuming doesn't work for WCG, upload-resuming does work.
----------------------------------------


"I make so many mistakes. But then just think of all the mistakes I don't make, although I might."
[Apr 10, 2011 4:46:48 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Download overruns

But, the WCG download-server intentionally overlooks the client-info, and always re-start the download from beginning. Since client isn't aware of this, the download will continue past 100%.


Looks like program flow error shared by both server and client.

My BOINC version is 6.12.15 (x86) from a recompiled package on Launchpad.

My OS is Ubuntu 10.04LTS on Linux 2.6.32-30-generic

So, a current version is close. I think it's a scripting glitch either or both in the client and server program files. Ho Hum. Crunch, crunch, crunch.('crying')
[Apr 10, 2011 10:53:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread