Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 10
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1179 times and has 9 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
HFP2 Is not Dial-up friendly

With 23.5 MB first application download, and 1.3 MB WUs dounload, the HPF2 is not dial-up friendly. May I suggest that "broadband connection" be clearly specified in the HFP2 project requirements.
[Feb 18, 2007 7:54:08 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: HFP2 Is not Dial-up friendly

I agree. I have suggested before that we add a section to the bottom of the page that lists expected download and upload requirements for a project.

Lawrence
[Feb 18, 2007 8:28:18 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: HFP2 Is not Dial-up friendly

Per a post by knreed HPF2 uses the same in-build (UPX?) compression for the WU downloads as Rosetta, where the origins of HPF are. Fortunately the application is one time, but as commented here it could be sized down dramatically.

On a per hour crunch, HDC is worse, 5mb a pop.

Added: Tried compressing with the best i know and not but a few % gain if zipped on these hi res image files. Seemingly there is UBX compression format as well, but Rosetta reports use of UPX
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
----------------------------------------
[Edit 1 times, last edit by Sekerob at Feb 19, 2007 1:07:49 PM]
[Feb 18, 2007 8:56:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: HFP2 Is not Dial-up friendly

Per a post by knreed HPF2 uses the same in-build (UPX?) compression for the WU downloads as Rosetta, where the origins of HPF are. Fortunately the application is one time, but as commented here it could be sized down dramatically.

On a per hour crunch, HDC is worse, 5mb a pop.

looking at this linked thread, this application definitly needs to be compressed using UBX. Ten minutes work by wcg would make a huge difference to thousands of new participants.

If HDC downloads are 5 MBytes per hour, I imagine a 24/7 dual core host would be downloading 7.2 GB per month, which would translate to 9 GB usage with overhead added. Some ISPs have pakages with 10 GB monthly download limits. I agree that broadband usage needs to be added to the requirements.

I would not be a happy camper if I recieve an email from my ISP telling me that my monthly allowance will be shortly exceeded.
----------------------------------------
[Edit 1 times, last edit by Former Member at Feb 19, 2007 1:03:14 PM]
[Feb 19, 2007 1:02:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
retsof
Former Community Advisor
USA
Joined: Jul 31, 2005
Post Count: 6824
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HFP2 Is not Dial-up friendly

I am running dial-up here.

FAAH probably has the smallest download/upload packages of any of the subprojects currently running here on WCG.

Other BOINC projects have an even wider range of package sizes. I recently tried a couple of malaria control workunits. They took 2 hours to run on this fast computer, but only 4 seconds each to upload on dial-up.

Going in the other direction, the climate simulation BOINC projects are even more dramatic. It may take several months to complete a workunit, but subchecks are sent in each day and points-to-date assigned.
----------------------------------------
SUPPORT ADVISOR
Work+GPU i7 8700 12threads
School i7 4770 8threads
Default+GPU Ryzen 7 3700X 16threads
Ryzen 7 3800X 16 threads
Ryzen 9 3900X 24threads
Home i7 3540M 4threads50%
[Feb 20, 2007 4:51:05 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: HFP2 Is not Dial-up friendly

Please see this news bulletin: Compressing files download by the BOINC client

BOINC now does on the fly compression from server to the client from version 5.4 and up. Tests have shown some phenomenal improvements. Watch the HDC Mask and PGM files come across and be astound. The compression includes also any science programs being upgraded!
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
----------------------------------------
[Edit 1 times, last edit by Sekerob at Feb 27, 2007 3:51:27 PM]
[Feb 27, 2007 3:49:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: HFP2 Is not Dial-up friendly

Thank you very much for implementing a solution. The quick responce of the WCG management team is highly appreciated.
[Mar 2, 2007 10:56:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: HFP2 Is not Dial-up friendly

meshmesh, I'm sure WCG thanks you for the lauding..... the next step is activating the client to server compression of the results..... same as for downloading, >= BOINC 5.4 is required, preferably >= 5.8.15.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Mar 3, 2007 9:04:00 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: HFP2 Is not Dial-up friendly

..... the next step is activating the client to server compression of the results.....

Agree. On faah project, the WU download is about 195 KBytes uncompressed, which now would be much smaller after introduction of the new compression mechanism.

However, the upload of the faah results can be up to 450 KBytes per WU (varies depending on the length of the wu). Would be great if client side result compression is implemented too. We can only wait and hope.
----------------------------------------
[Edit 1 times, last edit by Former Member at Mar 3, 2007 7:30:41 PM]
[Mar 3, 2007 7:30:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: HFP2 Is not Dial-up friendly

The 'wait' & 'hope' .... think knreed doesn't mind sharing this bit of exchange on Feb.23:
Question: "Someone just bringing up bandwidth usage limitations over satellite. Will uploads also get compressed? Some are still in the 400-600kb range."

Answer: "The BOINC 5.8 client has supported for built-in upload compression. I haven't had time to start testing it out yet to make sure that it works correctly and implement backend mechanisms to handle results where some are compressed and some are not."

----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Mar 3, 2007 7:46:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread