Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 144
Posts: 144   Pages: 15   [ Previous Page | 4 5 6 7 8 9 10 11 12 13 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 29312 times and has 143 replies Next Thread
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2221
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Too many Pending Validation

@Unixchick

You're right. I also have lots of validated tasks, that normally should have been cleared from the result list, several days ago.
[Feb 23, 2023 4:16:17 PM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 988
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Too many Pending Validation

Unixchick and GrumpySwede;

I've had a look at my backlog of validated tasks (using the old API) and it appears that most of them have the delete_state set to FILE_DELETE_DONE as one would expect when a result is assimilated. However, this implies that the purge system is not running at present, since once units are marked thus they should go away at the next purge, not hang around for several days!

Unfortunately, the new API doesn't expose values such as the file delete state, and the old API can only be used on one's own results so I can't check Unixchick's example -- however, I'm fairly sure as to what I'd find... :-(

Ah, well; perhaps someone at WCG might comment on this...

Cheers - Al.
[Feb 23, 2023 5:02:14 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 999
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Too many Pending Validation

I'm posting to this thread again, in hopes that cyclops will see this and mention it to the team. My WU I posted a link to yesterday is still there. Al gave some good info. I'm worried that the DB purge isn't working.
[Feb 24, 2023 3:57:00 PM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 988
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Too many Pending Validation

I'm posting to this thread again, in hopes that cyclops will see this and mention it to the team. My WU I posted a link to yesterday is still there. Al gave some good info. I'm worried that the DB purge isn't working.
I'm currently trying to script something to give some solid data about the state of my returned, validated, results as at present -- once I've got something "short and to the point" I'm going to pop it in one of the News forum threads (unless old results mysteriously starts to disappear in the meantime...)

Cheers - Al.
[Feb 24, 2023 5:00:10 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2177
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Too many Pending Validation

I'm currently trying to script something to give some solid data about the state of my returned, validated, results as at present -- once I've got something "short and to the point" I'm going to pop it in one of the News forum threads (unless old results mysteriously starts to disappear in the meantime...)

Cheers - Al.

Al., I wish I could help you in some way. If it would give you some sort of idea …
I would show - if I would be me wink - page 370, the oldest, of my validated results.
Each page normally contains 15 workunits, this last page contains only 14 items.

$ wcgstats -w -sV -a0 -m0 -AS
There are 370 pages of results available.

* Showing page 370/370 of all tasks with status ’V’ on all of your devices:
<1> MCM1_0196064_6494_0 Linux Ubuntu Detach. 2023-02-06T04:52:57 2023-02-06T10:16:51
<1> * MCM1_0196064_6494_1 Fedora Linux Valid 2023-02-06T04:53:06 2023-02-06T10:18:24
<1> MCM1_0196064_6494_2 Linux Ubuntu Valid 2023-02-06T10:17:10 2023-02-12T11:59:17
<1> MCM1_0196064_6494_3 Linux Ubuntu Valid 2023-02-12T10:17:27 2023-02-12T13:05:19

<2> * MCM1_0196064_1177_0 Fedora Linux Valid 2023-02-06T04:40:52 2023-02-06T09:22:06
<2> MCM1_0196064_1177_1 Linux Ubuntu Valid 2023-02-06T04:40:36 2023-02-11T21:14:57

<3> * MCM1_0196063_6249_0 Fedora Linux Valid 2023-02-06T03:51:16 2023-02-06T09:04:04
<3> MCM1_0196063_6249_1 Linux Ubuntu Error 2023-02-06T03:51:02 2023-02-12T03:52:10
<3> MCM1_0196063_6249_2 Linux Valid 2023-02-12T03:51:23 2023-02-12T16:03:07

<4> * MCM1_0196034_9781_0 Fedora Linux Valid 2023-02-06T03:18:58 2023-02-06T08:29:15
<4> MCM1_0196034_9781_1 Linux Ubuntu Valid 2023-02-06T03:18:43 2023-02-10T04:52:10

<5> MCM1_0196060_9104_0 Linux Ubuntu Valid 2023-02-06T03:18:43 2023-02-10T08:54:36
<5> * MCM1_0196060_9104_1 Fedora Linux Valid 2023-02-06T03:18:58 2023-02-06T08:02:52

<6> MCM1_0196061_7960_0 Linux Ubuntu Error 2023-02-06T02:30:18 2023-02-13T11:46:15
<6> * MCM1_0196061_7960_1 Fedora Linux Valid 2023-02-06T02:31:26 2023-02-08T04:28:11
<6> MCM1_0196061_7960_2 Linux Valid 2023-02-12T02:31:04 2023-02-12T11:19:38

<7> MCM1_0196035_6843_0 Linux Debian Valid 2023-02-06T01:48:30 2023-02-11T21:18:05
<7> * MCM1_0196035_6843_1 Fedora Linux Valid 2023-02-06T01:50:18 2023-02-06T07:28:17

<8> MCM1_0196033_6285_0 Linux Ubuntu Valid 2023-02-06T01:32:48 2023-02-08T15:06:10
<8> * MCM1_0196033_6285_1 Fedora Linux Valid 2023-02-06T01:33:12 2023-02-06T07:21:53

<9> MCM1_0196028_6945_0 Linux Debian Valid 2023-02-06T01:22:09 2023-02-09T18:41:55
<9> * MCM1_0196028_6945_1 Linux Ubuntu Valid 2023-02-06T01:21:59 2023-02-06T04:26:46

<10> MCM1_0196059_2535_0 Linux openSU Valid 2023-02-06T00:55:47 2023-02-08T12:53:27
<10> * MCM1_0196059_2535_1 Fedora Linux Valid 2023-02-06T00:55:22 2023-02-06T06:35:13

<11> MCM1_0196029_2072_0 CentOS Linux Valid 2023-02-06T00:16:44 2023-02-11T18:17:43
<11> * MCM1_0196029_2072_1 Fedora Linux Valid 2023-02-06T00:16:25 2023-02-06T06:24:09

<12> MCM1_0196033_1405_0 Linux openSU Valid 2023-02-05T23:00:13 2023-02-09T13:42:23
<12> * MCM1_0196033_1405_1 Fedora Linux Valid 2023-02-05T23:00:20 2023-02-06T05:06:05

<13> MCM1_0196035_1081_0 Linux Ubuntu Valid 2023-02-05T22:52:14 2023-02-08T13:34:05
<13> * MCM1_0196035_1081_1 Fedora Linux Valid 2023-02-05T22:51:49 2023-02-06T05:03:57

<14> * MCM1_0196030_0532_0 Fedora Linux Valid 2023-02-05T22:18:51 2023-02-06T05:01:49
<14> MCM1_0196030_0532_1 Linux Ubuntu Valid 2023-02-05T22:18:42 2023-02-10T09:45:40


Adri
----------------------------------------
[Edit 2 times, last edit by adriverhoef at Feb 24, 2023 6:59:14 PM]
[Feb 24, 2023 6:55:26 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7699
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Too many Pending Validation

Pretty similar here. I have a little over 2400 completed results with the oldest one completed Feb. 6, 2023 at 19:08:16 UTC still on the list. Most of them are marked valid with about 337 pending validation, which is just a little above normal.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
----------------------------------------
[Edit 1 times, last edit by Sgt.Joe at Feb 24, 2023 8:46:30 PM]
[Feb 24, 2023 8:43:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Cyclops
Senior Cruncher
Joined: Jun 13, 2022
Post Count: 295
Status: Offline
Reply to this Post  Reply with Quote 
Re: Too many Pending Validation

Hi all, we updated the Comprehensive Bug List thread to include the validations issues, though it doesn't include much new information. As always, updates on this situation will be posted when we have some news to share.
[Feb 24, 2023 9:40:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 999
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Too many Pending Validation

Cyclops - I don't think you stated the problem correctly. It isn't that WUs are pending validation, but that verified valid WUs aren't being cleared from the database.
[Feb 25, 2023 12:17:16 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2221
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Too many Pending Validation

Well, the problem is still also that WU's that should be validated, either because both/all wingmen have finished them, or in the case of OPNG, (since they can be "Minimum Quorum: 1 Replication: 1"), are still sitting in Pending Validation for a long time.

As of now, I have many OPNG tasks, that are still waiting for the validator to do its thing,

So, it's multiple problems here. First the one where tasks that should be validated, waits a long time for the validator, and then the problem with tasks that should be purged, sits for many days without being purged.

I know this thread is mostly about MCM1, but the problem is also with OPNG WU's. Since I do not do OPN1 just now, I can't say if the validator problem also applies to OPN1.
----------------------------------------
[Edit 1 times, last edit by Grumpy Swede at Feb 25, 2023 1:29:43 AM]
[Feb 25, 2023 1:16:48 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Aperture_Science_Innovators
Advanced Cruncher
United States
Joined: Jul 6, 2009
Post Count: 139
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Too many Pending Validation

Well, the problem is still also that WU's that should be validated, either because both/all wingmen have finished them, or in the case of OPNG, (since they can be "Minimum Quorum: 1 Replication: 1"), are still sitting in Pending Validation for a long time.

As of now, I have many OPNG tasks, that are still waiting for the validator to do its thing,

So, it's multiple problems here. First the one where tasks that should be validated, waits a long time for the validator, and then the problem with tasks that should be purged, sits for many days without being purged.

I know this thread is mostly about MCM1, but the problem is also with OPNG WU's. Since I do not do OPN1 just now, I can't say if the validator problem also applies to OPN1.

> I know this thread is mostly about MCM1, but the problem is also with OPNG WU's. Since I do not do OPN1 just now, I can't say if the validator problem also applies to OPN1.

A quick look through some of my results suggests _no_. The OPN1 tasks appear to be validating pretty quickly, and the ones that are pending validation are all waiting on the wingman to return first.
----------------------------------------

[Feb 25, 2023 3:03:38 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 144   Pages: 15   [ Previous Page | 4 5 6 7 8 9 10 11 12 13 | Next Page ]
[ Jump to Last Post ]
Post new Thread