Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 450
Posts: 450   Pages: 45   [ Previous Page | 28 29 30 31 32 33 34 35 36 37 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 789717 times and has 449 replies Next Thread
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2070
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunits are being sent out

Al, just a quick note from me regarding OPNG batch numbers. You wrote:
the highest OPNG batch number I saw pre-hiatus was 0149788
That may have been received by you on 2022-02-13.
My highest was received on 2022-02-14 and it was numbered 0150086.

After the hiatus, my lowest OPNG batch number was 0150090, received on 2022-09-11.
Currently, my highest OPNG batch number is 0156576, received on 2022-09-13.
All dates are in UTC. cool
[Sep 15, 2022 11:38:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
PowerFactor
Ace Cruncher
Joined: Dec 9, 2016
Post Count: 4015
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunits are being sent out


Edit: If they truly are running the same units for which they already have valid results, I would want to know why. You have a good point about not doing busy work.
Cheers


Why would they not run some old work units during a testing phase? Sounds like regression testing to me.
[Sep 16, 2022 2:13:15 AM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 859
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunits are being sent out

Al, just a quick note from me regarding OPNG batch numbers. You wrote:
the highest OPNG batch number I saw pre-hiatus was 0149788
That may have been received by you on 2022-02-13.
My highest was received on 2022-02-14 and it was numbered 0150086.

After the hiatus, my lowest OPNG batch number was 0150090, received on 2022-09-11.
Currently, my highest OPNG batch number is 0156576, received on 2022-09-13.
All dates are in UTC. cool
Adri, I was rather hoping you might pick up on this, as I suspect you might run more OPNG tasks than I do and I know you have the data :-)

I would never claim that what I saw was the actual upper or lower bound on a range, so getting better data is nice, especially as your examples for the batches for the older receptor almost completely close the gap!

Good guess about when I saw those jobs - last one was OPNG_0149788_00098_0 which completed not long after midnight on 2022-02-14 and validated without needing a wingman :-)

Thanks for the info - Al.

[Edit - corrected a reference (from ARP1 to OPNG - oops!)]
----------------------------------------
[Edit 1 times, last edit by alanb1951 at Sep 16, 2022 4:28:23 AM]
[Sep 16, 2022 3:37:38 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2069
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunits are being sent out

The OPNG hopper is empty. Please refill it. crying
[Sep 25, 2022 3:16:07 AM]   Link   Report threatening or abusive post: please login first  Go to top 
adrianxw
Senior Cruncher
Denmark
Joined: Apr 13, 2008
Post Count: 192
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunits are being sent out

Since the move, something I am seeing with African Rainfall in particular are comms issues. The AR work units have a number of files, some of which are quite large. I am seeing "downloading", (and uploading incidentally) retries. When I am here, I can keep poking the retry comms frequently until the files complete. If I was not doing that, the quite long runtimes and relatively short deadline are going to colide.
[Sep 25, 2022 6:51:43 PM]   Link   Report threatening or abusive post: please login first  Go to top 
phillipspencer
Advanced Cruncher
France
Joined: Apr 9, 2015
Post Count: 71
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunits are being sent out

Since the move, something I am seeing with African Rainfall in particular are comms issues. The AR work units have a number of files, some of which are quite large. I am seeing "downloading", (and uploading incidentally) retries. When I am here, I can keep poking the retry comms frequently until the files complete. If I was not doing that, the quite long runtimes and relatively short deadline are going to colide.

There is quite a lot of information on the comms upload and, in particular, download issues in the News thread 2022-09-15 Update (Networking & Workunits). Specifically, see Cubes (from Krembil) post yesterday: https://www.worldcommunitygrid.org/forums/wcg/viewpostinthread?post=676758
Agree with your comment about the turnround times being a problem if not babysitting the downloads.
Phillip
[Sep 25, 2022 8:03:44 PM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 859
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunits are being sent out

Since the move, something I am seeing with African Rainfall in particular are comms issues. The AR work units have a number of files, some of which are quite large. I am seeing "downloading", (and uploading incidentally) retries. When I am here, I can keep poking the retry comms frequently until the files complete. If I was not doing that, the quite long runtimes and relatively short deadline are going to colide.
My method for avoiding the runtime/deadline collision is to set the number of ARP1 tasks in the relevant profiles to one more than the number of ARP1 tasks I allow relevant hosts to run. I've never lost a task to a deadline, even when processing a so-called Extreme[1] task on a 1.5-day deadline! And I haven't set up an automated retry script, so it can back up quite a long way during sleep periods :-)

Cheers - Al.

[1] Using the names applied on the ARP1 stats download files, as often referenced in the "Work Available" thread in the Africa Rainfall Project forum; some of those grid cells are a lot of generations behind!
[Sep 25, 2022 9:43:05 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2069
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunits are being sent out

It seems as if they are holding back on OPNG and MCM1 tasks. I don't know about ARP1 though, since I do not run those. OPN1 though, seems to be pretty easy to get. No wonder the website is pretty snappy now.

Edit: An update from the Jurisica team wouldn't hurt though.....
----------------------------------------
[Edit 2 times, last edit by Grumpy Swede at Oct 12, 2022 8:33:04 AM]
[Oct 12, 2022 8:25:30 AM]   Link   Report threatening or abusive post: please login first  Go to top 
wildhagen
Veteran Cruncher
The Netherlands
Joined: Jun 5, 2009
Post Count: 729
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunits are being sent out

OPNG1 seems to be on and off. Earlier today I received car loads of them, but the last few hours, nothing at all. Only OPN1 is plenty available.

I have not received an ARP1-unit in the last 48 hours or so, on any of my 120 cores.

For MCM1 I only receive a very few resends now and then, no new work since this weekend (sunday morning, if I recall correctly).
[Oct 12, 2022 8:54:46 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 836
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunits are being sent out

ARP has been empty for a few days. I got a resend yesterday, but only one. I'm not sure why they haven't refilled the hoppers. Hopefully it is for a good reason. I'm ever hopeful that I'll get to work on ARP at the speed I want. The cool weather is here...I'm ready!
[Oct 12, 2022 4:35:31 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 450   Pages: 45   [ Previous Page | 28 29 30 31 32 33 34 35 36 37 | Next Page ]
[ Jump to Last Post ]
Post new Thread