Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 83
Posts: 83   Pages: 9   [ Previous Page | 1 2 3 4 5 6 7 8 9 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 15207 times and has 82 replies Next Thread
TigerLily
Senior Cruncher
Joined: May 26, 2023
Post Count: 280
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: ARP restart update

Hello all,

We are excited to share that we have received and are in the process of downloading the data needed from the ARP team. Based on the current download rate, we anticipate that the download will be complete this weekend. Barring any unforeseen challenges, this means that we expect ARP1 will restart next week. We will continue to provide any updates that we can regarding the exact timeframe.
[Jun 19, 2024 7:47:38 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Speedy51
Veteran Cruncher
New Zealand
Joined: Nov 4, 2005
Post Count: 1311
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: ARP restart update

Fantastic news, appreciate the update and work being done to get project going again.
I would be interested to hear the amount of data being transferred and the speed it’s been transferred if this information is allowed to be known?

At 10:58 PM Toronto time on Tuesday I was able to successfully download over 100 MCM tasks. I am unsure if the website was accessible at the time

Look forward to your response and been able to process ARP again
----------------------------------------

[Jun 19, 2024 10:50:59 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TLD
Veteran Cruncher
USA
Joined: Jul 22, 2005
Post Count: 824
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: ARP restart update

Good news, thanks for the update TigerLily.
----------------------------------------

[Jun 19, 2024 11:06:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TigerLily
Senior Cruncher
Joined: May 26, 2023
Post Count: 280
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: ARP restart update

Hi Speedy51,

We have already downloaded about 500GB and still need to download another archive of about 5TB.
[Jun 20, 2024 3:24:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Speedy51
Veteran Cruncher
New Zealand
Joined: Nov 4, 2005
Post Count: 1311
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: ARP restart update

thank you TigerLily, I appreciate this information
----------------------------------------

[Jun 20, 2024 9:27:54 PM]   Link   Report threatening or abusive post: please login first  Go to top 
giba
Veteran Cruncher
Brazil
Joined: Dec 2, 2004
Post Count: 851
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: ARP restart update

Hello all,

We are excited to share that we have received and are in the process of downloading the data needed from the ARP team. Based on the current download rate, we anticipate that the download will be complete this weekend. Barring any unforeseen challenges, this means that we expect ARP1 will restart next week. We will continue to provide any updates that we can regarding the exact timeframe.



Amazing ! let's downloading to crunch !
[Jun 20, 2024 11:32:59 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Hans Sveen
Veteran Cruncher
Norge
Joined: Feb 18, 2008
Post Count: 853
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: ARP restart update

@TigerLily:
Thank You for the latest updates!

Why not send out some Beta wus before or during the weekend to test the
infrastructure while no GPUs are running, better bandwith for testing?
Use some old wus to confirm the "new" run.

With regards,
Hans S.
[Jun 21, 2024 7:04:28 AM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2217
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: ARP restart update

Several thoughts crossed my mind last night as well as this morning. sleep

In order to prevent network congestion it would probably be best to set the maximum number of tasks for ARP1 to 1 before the project restarts, so that only 1 task is downloaded to your device at a time, when contacting the server. I had it set to 16. biggrin
When ARP1 is running smoothly where uploading and downloading is concerned, the maximum number of tasks for ARP1 can be set to your preferred value in your Device Profile.

I don't know for sure if the application program for ARP1 will change when the project restarts. (The application program's name starts with "wcgrid_arp1_wrf_7.32".) It probably doesn't, else it should and would have been announced. good luck
Like Hans Sveen mentioned, I was thinking of some BETA test with a batch of ARP1-workunits, just to see if the workflow works out good. And if it does, then give the real ARP1 the green light.

Furthermore, when TigerLily mentioned the total amount to be downloaded of 5 TB and the intermediate amount of 500 GB, I thought to myself: that is exactly 1/10th of the total amount. So if you know how long it took to download 500 GB, you can make a careful estimate of the total amount of time needed for 5 TB. But we don't know how long it took. d oh

Adri
[Jun 21, 2024 2:10:07 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7777
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: ARP restart update

But we don't know how long it took

That would be interesting to know at what speed their connection had and how the protocols for data integrity were implemented.
Depending the speed of the connection and the amount of data, sometimes it makes more sense just to ship a backup of the hard drive media and load the information directly from those drives.
Just as long as it is done correctly is the important part.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jun 22, 2024 1:42:59 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TigerLily
Senior Cruncher
Joined: May 26, 2023
Post Count: 280
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: ARP restart update

Hi all,

We shared the estimate that the 5 TB would be downloaded by the end of the weekend based on the projected time it would take to download the 500 GB archive. Since it was projected to take ~7 hours to download the 500 GB archive, we predicted it would take ~3 days for 5 TB. The tech team has confirmed that the download completed over the weekend, totalling just over 78 hours. They will be able to update tomorrow on whether the contents of these archives are sufficient to restart. If so, they will begin testing tomorrow.
[Jun 24, 2024 4:56:54 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 83   Pages: 9   [ Previous Page | 1 2 3 4 5 6 7 8 9 | Next Page ]
[ Jump to Last Post ]
Post new Thread