Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 567
Posts: 567   Pages: 57   [ Previous Page | 48 49 50 51 52 53 54 55 56 57 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 42046 times and has 566 replies Next Thread
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 1316
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Thanks for those posts from Windows users. Note that Grumpy Swede's singleton new task also showed up during the narrow period when Adri and I also got new [Linux] work...

In the meantime, based on my [20000+] visible results returned after the migration it appears that no progress is currently being made on tasks stuck in PVal jail[*1] for more than a week, but assimilation of already validated work for the last week of that period is progressing. As for results returned in the last week, it still seems that the older the WU the more likely it is that the results will end up in PVal jail...

Cheers - Al.

*1 -- using the "Two or more results Pending Validation" definition of jail.
[Nov 26, 2025 7:11:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2492
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

This time, I have not contacted Igor. The other times with the same issue, I did contact him, and it did not take long before work started flowing again. I have a feeling that Dylan doesn't easily notice when tasks are not sent out. I will wait until tomorrow or so, before I send another mail to Igor. Maybe it's time for someone else to send a friendly mail to Igor Jurisica about this issue.

The tasks that reached us just before the issue started again, have a create date of Nov. 18, 2025. The same applies to tasks sent out even before these problems (after the migration). They are all created several days before they are sent out. Before this "migration", the create date for new work, was usually the same day they were sent out.

So, it seems as if their system is creating new work, even when almost no work is sent out.

I guess the issue they need to work on can be seen in the Operational Status of November 21, and that the "manual intervention" just doesn't happen.

Excerpt: ".....to resolve frequent "stuck" feeder states where "No tasks available for platform" is logically incorrect by hr_class, yet the tasks populating the feeder shared memory segment remain unassigned by the scheduler passes and manual intervention is required to get work flowing again."
----------------------------------------
[Edit 1 times, last edit by Grumpy Swede at Nov 27, 2025 12:19:28 AM]
[Nov 27, 2025 12:04:36 AM]   Link   Report threatening or abusive post: please login first  Go to top 
bfmorse
Senior Cruncher
US
Joined: Jul 26, 2009
Post Count: 442
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Selected current grouping as of
2025-11-12 23:59:48 UTC; 2025-11-13 02:24:20 UTC; 2025-11-13 04:29:58 UTC; 2025-11-13 14:08:02 UTC; 2025-11-13 16:45:52 UTC; 2025-11-14 18:56:02 UTC; 2025-11-16 02:33:09 UTC; 2025-11-16 16:50:41 UTC; 2025-11-18 05:12:14 UTC; 2025-11-18 17:31:49 UTC; 2025-11-20 05:27:00 UTC; 2025-11-21 06:08:47 UTC; *Account Last updated: Nov. 23, 2025 - 00:06 UTC; 2025-11-25 07:32:58 UTC; User Stats Last updated: Nov. 26, 2025 - 12:06 UTC

the following are at current time:

In progress - 229 items; 240 items; 260 items; 253 items; 242 items; 240 items; 241 items; 245 items; 241 items; 104 items; 312 items; 310 items; *21 items; 6 items; 0 items

Pending Validation - 13801 items; 13853 items; 13952 items; 14319 items; 14394 items; 14897 items; 15371 items; 15820 items; 16503 items; 16614 items; 17259 items; 18139 items; *19105 items; 21846 items [oldest 2025-08-21 09:36:32 UTC]; 21579 items [most recent sent time 2025-11-24 19:30:42 UTC]

Valid - 47260 items; 47272 items; 47306 items; 47592 items; 47702 items; 48813 items; 50384 items; 50850 items; 52512 items; 53192 items; 54597 items; 56066 items; *58811 items; 59067 items [oldest 2025-08-08]; 59345 items

* - indicates placekeeper data - during "Server error feeder not running" issues over several hours on 11/23

Computer's OS are WinXP, Win10 and Win11
Let me know if you want additional information.
[Nov 27, 2025 12:14:48 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2492
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

And now there's "Transient HTTP errors" for uploads.
[Nov 27, 2025 12:33:58 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2492
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

New fresh work is sent out. (Work created: Nov. 27, 2025)
----------------------------------------
[Edit 2 times, last edit by Grumpy Swede at Nov 27, 2025 3:04:30 AM]
[Nov 27, 2025 3:00:14 AM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Some of the MCM1-work from the end of August is now also being validated. Have seen tasks in the API that were distributed on 27, 28, 29 and 30 August turning Valid in the past hours using output of wcglog.

Adri
----------------------------------------
[Edit 3 times, last edit by adriverhoef at Nov 27, 2025 12:19:07 PM]
[Nov 27, 2025 12:03:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
bfmorse
Senior Cruncher
US
Joined: Jul 26, 2009
Post Count: 442
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Selected current grouping as of
2025-11-12 23:59:48 UTC; 2025-11-13 02:24:20 UTC; 2025-11-13 04:29:58 UTC; 2025-11-13 14:08:02 UTC; 2025-11-13 16:45:52 UTC; 2025-11-14 18:56:02 UTC; 2025-11-16 02:33:09 UTC; 2025-11-16 16:50:41 UTC; 2025-11-18 05:12:14 UTC; 2025-11-18 17:31:49 UTC; 2025-11-20 05:27:00 UTC; 2025-11-21 06:08:47 UTC; *Account Last updated: Nov. 23, 2025 - 00:06 UTC; 2025-11-25 07:32:58 UTC; Last updated: Nov. 26, 2025 - 12:06 UTC; 2025-11-28 03:22:28 UTC


The following are at current time:

In progress - 229 items; 240 items; 260 items; 253 items; 242 items; 240 items; 241 items; 245 items; 241 items; 104 items; 312 items; 310 items; *21 items; 6 items; 0 items; 248 items

Pending Validation - 13801 items; 13853 items; 13952 items; 14319 items; 14394 items; 14897 items; 15371 items; 15820 items; 16503 items; 16614 items; 17259 items; 18139 items; *19105 items; 21846 items [oldest 2025-08-21 09:36:32 UTC]; 21579 items [most recent sent time 2025-11-24 19:30:42 UTC]; 19792 items

Valid - 47260 items; 47272 items; 47306 items; 47592 items; 47702 items; 48813 items; 50384 items; 50850 items; 52512 items; 53192 items; 54597 items; 56066 items; *58811 items; 59067 items [oldest 2025-08-08]; 59345 items; 63224 items

* - indicates placekeeper data - during "Server error feeder not running" issues over several hours on 11/23

Quick notes: PENDING VALIDATION quantity has dropped by several thousand but VALID has risen - indicating, in my mind, that although the results are valid, the data has not been retired from active status - as a precation (see previous notes from WCG tech).
[Nov 28, 2025 3:42:34 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 1293
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Nice to have a good flow of WUs. I'm hoping for a good flow weekend.

Thank you to Adri and bfmorse for having the data to show that things are slowly being validated. We must celebrate small wins.
[Nov 28, 2025 6:17:25 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Hans Sveen
Veteran Cruncher
Norge
Joined: Feb 18, 2008
Post Count: 981
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Speaking of good flow, yesterday we returned 2,203,940 results!

It has only happened 3 times that more than 2 million results has been returned since the statistics history began 11/08/2013.

Before yesterday last time that happened was 01/11/2025 with 2,262,634 results(All time high!)

First time it happened was 10/11/2023 with 2,069,499 returned results.

To finish today "play" with numbers, first time we had more than 1 million results returned was 1,089,345 on 06/21/2014!
[Nov 28, 2025 7:53:53 AM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 1316
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Some of the MCM1-work from the end of August is now also being validated. Have seen tasks in the API that were distributed on 27, 28, 29 and 30 August turning Valid in the past hours using output of wcglog.

Adri
I think that might have been a fairly short-lived experiment, as I have only seen 2 (two) tasks I returned on 2025-08-30 change from PVal to Valid in the past 24 hours (both needed a retry for the initial wingman and both those came back well into October...) -- I still have 1095 pre-migration tasks awaiting validation.

Now, clearing the PVal jail backlog of post-migration tasks is a different matter smile. That huge increase in results returned (according to the Project Statistics history, as just highlighted by Hans Sveen) is almost certainly nearly all post-migration validation catch-ups -- in my case it validated 1369, (reducing the PVal jail cases by about 20%!). I now have 5504 in PVal jail and 500 still waiting for a wingman.

If it can keep up this level of validation, it should get caught up within a few days. We'll have to watch out for any serious movement on pre-migration tasks

Cheers - Al.

P.S. What I'm really looking forward to is the restart of file deletion and database purge; there's going to be a lot of data to remove wink
[Nov 28, 2025 8:05:41 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 567   Pages: 57   [ Previous Page | 48 49 50 51 52 53 54 55 56 57 | Next Page ]
[ Jump to Last Post ]
Post new Thread