Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 126
Posts: 126   Pages: 13   [ Previous Page | 4 5 6 7 8 9 10 11 12 13 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 12696 times and has 125 replies Next Thread
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7594
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: No work?

Just a thought, given the large number of different ways feeders can be configured... It's behaving as if new work has somehow been explicitly given priority to try to avoid the log-jam caused by large numbers of retries :-) -- if so, there's a high chance that most (or all?) long-standing retries won't clear while there's a lot of new work hitting the feeder. (Most retries triggered by the validator to resolve Pending Verification seem to be immune to the problem [at present...])

Interesting thoughts. I did notice the numbers of SCC units completed per day had climbed over the 600,000 threshold. This could be from the techs manipulating the ratio of work units between MCM and SCC as I see over 80 years worth of time for SCC which is higher than it has been. Another thought is since SCC runs so much more efficiently on Linux than Windows, that users with Linux have switched their machines to running more SCC. I have not noticed any change in the ratio of my pending work units to my completed work units which has been hovering around the 10% level.
All that being said, it is refreshing to see a steady supply of work units for both SCC and MCM. The more we process, the closer we get to successfully advancing the goals of the projects.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Aug 29, 2023 5:13:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
BobbyB
Veteran Cruncher
Canada
Joined: Apr 25, 2020
Post Count: 603
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: No work?

users with Linux have switched their machines to running more SCC
Yes 20 MCM on my 3900x and 10 on my 3600x.

Also the SCCs are mostly 30 minutes on my 2 Ryzens so this may be why there are so many SCC units completed per day. MCM ~ 1.30hrs
it is refreshing to see a steady supply of work units for both SCC
Yes no babysitting for about 1 week
[Aug 29, 2023 7:46:24 PM]   Link   Report threatening or abusive post: please login first  Go to top 
hchc
Veteran Cruncher
USA
Joined: Aug 15, 2006
Post Count: 750
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: No work?

alanb1951 said:
(Most retries triggered by the validator to resolve Pending Verification seem to be immune to the problem [at present...])


It's both Pending Verification and Pending Validation. Here is a screenshot of some of mine that are stuck in Waiting to be Sent. Oldest was returned on August 9.



There's probably more that aren't in this screenshot.
----------------------------------------
  • i3-8100 (Coffee Lake, 4C/4T) @ 3.6 GHz
  • i5-4590 (Haswell, 4C/4T) @ 3.3 GHz
  • E5800 (Wolfdale, 2C/2T) @ 3.2 GHz

[Aug 29, 2023 9:27:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Speedy51
Veteran Cruncher
New Zealand
Joined: Nov 4, 2005
Post Count: 1268
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: No work?

Also the SCCs are mostly 30 minutes on my 2 Ryzens so this may be why there are so many SCC units completed per day.

I have to agree with you. I am also getting around 30 minutes on my Ryzen 7900X Windows 11 pro 22H2.

I was hoping it was a surge of tasks waiting for "validation" or "verification". For me very few of my over 200 waiting results have moved
----------------------------------------

[Aug 29, 2023 11:18:14 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7594
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: No work?

I was hoping it was a surge of tasks waiting for "validation" or "verification". For me very few of my over 200 waiting results have moved

My oldest "pending validation" was returned Aug. 10 and the status on the other unit is "waiting to be sent."
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Aug 30, 2023 1:39:47 AM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 884
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: No work?

In reply to hchc 's post above:
alanb1951 said:
(Most retries triggered by the validator to resolve Pending Verification seem to be immune to the problem [at present...])

It's both Pending Verification and Pending Validation. Here is a screenshot of some of mine that are stuck in Waiting to be Sent. Oldest was returned on August 9.
[Screenshot snipped, but I observed three _0 tasks for MyoD1-C...]

Yup, sorry -- I could've been a bit more clear there; I was only intending to count retries triggered by the validator, and I suspect a lot of your Pending Verification items were Adaptive Replication rejections that got a _1 retry that then failed No Reply or otherwise and the next retry was triggered by the transitioner, not the validator! Without access to workunit numbers, checking the actual progress of tasks is purely speculative, of course :-)

Here are a couple of examples of WUs from the 16th, one for each case. Dates are UTC, and I've used NSD to indicate a task that returned an Error about the time the deadline ran out with just the client version reported (WCG doesn't seem to flag "Not Started by Deadline"...)

SCC1_0004193_MyoD1-C_75946 (WU 353852073 created 2023-08-14T21:02:16
Task _0 Sent 2023-08-15T18:06:47 Returned 2023-08-16T01:50:59 Status Valid
Task _1 Sent 2023-08-16T01:51:25 Returned 2023-08-17T17:24:30 Status Valid

Task SCC1_0004192_MyoD1-C_90798 (WU 354208821) created 2023-08-15T01:17:14
Task _0 Sent 2023-08-15T23:55:43 Returned 2023-08-25T23:52:32 Status NSD
Task _1 Sent 2023-08-15T23:55:52 Returned 2023-08-16T04:59:00 Status PVal
Task _2 Waiting to be sent

Note how the first one presumably went straight to a validator request (which didn't declare the result canonical, thus causing a retry) whilst the second one (which is still stalled!) hasn't yet been seen by the validator... Without access to the WCG validator code it is not possible to look at what [extra?] flags might be being set on an AR rejection, but the retry requests for the two cases are almost certainly going through different code paths in the transitioner :-)

For what it's worth, I currently have 4 SCC1 tasks Pending Verification -- all of them are FLI1-B tasks that were singletons that didn't get AR validation, and all four currently have confirmation retries in progress (all of which issued within an hour.) I also have 10 waiting for a task to be sent, but those are all Pending Validation.

Sorry for any confusion...

Cheers - Al.

P.S. My experience of tracing code for AR validation is based on looking into MilkyWay code as an outside observer when they had serious problems after a major disk crash. Someone else may well have more/better experience :-)
[Aug 30, 2023 3:53:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1934
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: No work?

Looks like the SCC1 WUs are beginning to run out again... :(
Keep getting MCM1 as alternative project WUs instead...

Ralf
----------------------------------------

[Sep 3, 2023 8:36:26 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1934
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: No work?

Looks like the SCC1 WUs are beginning to run out again... :(
Keep getting MCM1 as alternative project WUs instead...

Ralf
Well, come Tuesday morning after a long weekend, and it seems that MCM1 is in short supply as well... :(


Ralf
----------------------------------------

[Sep 5, 2023 2:29:53 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1934
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: No work?

Well, Tuesday after a long weekend came and went and not a single word from WCG Towers what the situation is with the SCC1 WU well running dry.... sad


Ralf
----------------------------------------

[Sep 6, 2023 2:21:52 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12160
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: No work?

SCC1 is out of work even before the weekend.

Mike
[Sep 8, 2023 11:42:39 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 126   Pages: 13   [ Previous Page | 4 5 6 7 8 9 10 11 12 13 | Next Page ]
[ Jump to Last Post ]
Post new Thread