Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 9
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2793 times and has 8 replies Next Thread
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Validation for ALL projects disabled [ Restarted ]

Good afternoon,

I am doing some additional follow up work from the scan that we did yesterday. Due to this, I'm going to disable some of the backend tasks that would cause extra IO on the system. This includes validation. I will keep the transitioner, feeder, uploads, and downloads active. So from an end client viewpoint, all that is happening is validation is delayed.

Thanks for your patience on this,
-Uplinger
----------------------------------------
[Edit 1 times, last edit by uplinger at Sep 12, 2020 5:02:53 AM]
[Sep 11, 2020 7:44:51 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Validation for ALL projects disabled

sad
[Sep 12, 2020 1:33:57 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Validation for ALL projects disabled

I'm getting close to turning things back on. It should be to a phase where having the additional IO isn't going to cause an issue.

Thanks,
-Uplinger
[Sep 12, 2020 3:57:16 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Validation for ALL projects disabled

Validation has been turned back on.

Thanks,
-Uplinger
[Sep 12, 2020 5:02:26 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Validation for ALL projects disabled

Validation has been turned back on.
Thanks!
Now let's see how long it takes until things are getting back to normal...

Ralf
[Sep 12, 2020 5:15:01 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Validation for ALL projects disabled

1485 arp1 to validate 2020-09-12 05:18:18
33327 beta24 to validate 2020-09-12 05:18:18
15 mcm1 to validate 2020-09-12 05:18:18
118918 mip1 to validate 2020-09-12 05:18:18
333341 opn1 to validate 2020-09-12 05:18:18
1158 arp1 to assimilate 2020-09-12 05:18:18
36277 beta24 to assimilate 2020-09-12 05:18:18
37850 mcm1 to assimilate 2020-09-12 05:18:18
55849 mip1 to assimilate 2020-09-12 05:18:18
155 opn1 to assimilate 2020-09-12 05:18:18

Note: they must validate to then get to assimilation. So about 150k have been validated already. I'll post another one when I get ready to sign off for the night...should give an idea of the speed on the backend.

Thanks,
-Uplinger
[Sep 12, 2020 5:20:06 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Validation for ALL projects disabled

As promised.. about 8 minutes 30 seconds apart.

807 arp1 to validate 2020-09-12 05:26:45
15497 beta24 to validate 2020-09-12 05:26:45
1 mcm1 to validate 2020-09-12 05:26:45
67316 mip1 to validate 2020-09-12 05:26:45
295175 opn1 to validate 2020-09-12 05:26:45
1744 arp1 to assimilate 2020-09-12 05:26:45
54159 beta24 to assimilate 2020-09-12 05:26:45
22045 mcm1 to assimilate 2020-09-12 05:26:45
81486 mip1 to assimilate 2020-09-12 05:26:45
229 opn1 to assimilate 2020-09-12 05:26:45

apr1 validation ~ 80 per minute ~ 8 minutes left
beta24 validation ~ 2100/min ~ 8 minutes left
mcm1 validation ~ NA already caught up
mip1 validation ~ 6000/min ~ 11 minutes left
opn1 validation ~ 4500/min ~ 65 minutes left

Thanks,
-Uplinger
[Sep 12, 2020 5:31:59 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Validation for ALL projects disabled

Well,...

While validation seemed to have restarted and more or less worked off the backlog, things are not all in the clear it seems.

For one, the ratio of WUs in the PVa/PVe jail are still about 4x what it used to be a couple of months ago.

And now it seems to at least take much longer until validated results are getting purged. The number of WUs marked as valid keeps increasing noticeably...

Ralf
[Sep 13, 2020 1:43:58 AM]   Link   Report threatening or abusive post: please login first  Go to top 
KerSamson
Master Cruncher
Switzerland
Joined: Jan 29, 2007
Post Count: 1684
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Validation for ALL projects disabled

Hi Ralf,
on my side, I cannot confirm your observation:
  • PV list decreased to 50%; in particular because the Beta results have been validated over the last 48 hours.
  • A long PV list is mostly caused by members buffering too many WUs and for some of them not being able to timely return results. This phenomenon becomes more significant since the launch of OPN1; it is also noticeable regarding ARP1.

Cheers,
Yves
----------------------------------------
[Sep 13, 2020 12:53:16 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread