Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 21
Posts: 21   Pages: 3   [ 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 3359 times and has 20 replies Next Thread
Movieman
Veteran Cruncher
Joined: Sep 9, 2006
Post Count: 1042
Status: Offline
Reply to this Post  Reply with Quote 
At the risk of asking the obvious, is the validation server overloaded?

I'm showing 188 pages "pending validation" and it keeps growing.
Thanks
----------------------------------------

[Oct 22, 2012 4:54:49 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: At the risk of asking the obvious, is the validation server overloaded?

MM, with 188 PV pages, do a random sampling and click on the WU names to see if the wingman has arrived... no wingman, no validation. Not expecting you to hit the "Try Validation" if it shows when there is a wingman, but then expect it to eventually catch up, no later starting as of a few hours after knreed arrives to the office.

Overloaded... maybe just not enough validators running on HCC [each science has it's own]. Last I read, knreed had added a validator to HCC, so guess there's at least 2 running. At 890,000 results yesterday, it is over 10 per second now. My general observation is that anything I have of Zero redundant, no wingman required, pretty much instantly validates, so as what I said before, think it's FTM confined to HCC if there's backlog.
[Oct 22, 2012 9:22:56 AM]   Link   Report threatening or abusive post: please login first  Go to top 
pirogue
Veteran Cruncher
USA
Joined: Dec 8, 2008
Post Count: 685
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: At the risk of asking the obvious, is the validation server overloaded?

I've still got some from 10/15 and 10/16 that haven't validated and are still out with a wingman.

Maybe 7 days is too long of a deadline for WUs that are generally taking far less than an hour.
----------------------------------------

[Oct 22, 2012 2:26:51 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Movieman
Veteran Cruncher
Joined: Sep 9, 2006
Post Count: 1042
Status: Offline
Reply to this Post  Reply with Quote 
Re: At the risk of asking the obvious, is the validation server overloaded?

MM, with 188 PV pages, do a random sampling and click on the WU names to see if the wingman has arrived... no wingman, no validation. Not expecting you to hit the "Try Validation" if it shows when there is a wingman, but then expect it to eventually catch up, no later starting as of a few hours after knreed arrives to the office.

Overloaded... maybe just not enough validators running on HCC [each science has it's own]. Last I read, knreed had added a validator to HCC, so guess there's at least 2 running. At 890,000 results yesterday, it is over 10 per second now. My general observation is that anything I have of Zero redundant, no wingman required, pretty much instantly validates, so as what I said before, think it's FTM confined to HCC if there's backlog.

Pretty much what I thought but I had to ask..
Thanks Sek for the info!

edit: Down to 140 pages now..
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by Movieman at Oct 22, 2012 5:23:28 PM]
[Oct 22, 2012 5:20:29 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: At the risk of asking the obvious, is the validation server overloaded?

Pirogue,

Really no idea what the server 700 can handle in terms of different deadline for different resource targets. The 7 days is for the HCC CPU tasks, so that all can participate, even very part-time, so FTM guess it's where the GPU tasks inherited the 7 days.

Not getting a wingman back on GPU tasks of the 15/16th... either one considers that in this upstart phase some try out and rubbish a system and try again, without aborting prior to rubbishing, or clients are still not able to prioritize properly. Still reading of cases where one project just wont let others in-between and assert themselves, hogging the resource [short deadline, long running tasks e.g.]. Until someone reports this with details on the WCG support forums of what project combinations show this behavior, can't carry that to techs or developers.
[Oct 22, 2012 5:43:15 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: At the risk of asking the obvious, is the validation server overloaded?

The two validators are keeping up. The long pending validation lists are due to wait times for wingman.

We would like to reduce the 7 day return window except that with the end of CFSW and near end of HCMD2, this is our only 'short' project. If we were to reduce the 7 day return window, there will be more users who cannot return any results within the allowed timeframe.

Even thought we want to keep them short, we are going to start putting multiple images into workunits. We are up to 1.3 million results per day and I will get very nervous as we approach 1.5 million results per day. Since we are working on Linux and Mac GPU now and we expect them to contribute a similar boost as Windows, we need to ensure we don't overwhelm the database. Unfortunately, this means pushing the CPU average time out to ~3 hours or so as we put two images into the workunits.

In the longer run we are also looking at ways to handle differently sized workunits within the same application. The goal here would be to put 3-4 images in a file for GPU processing and only 1 for CPU users. However there are some challenges involved in that so that will be awhile before we can implement.
[Oct 23, 2012 7:45:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
gomeyer
Senior Cruncher
USA
Joined: Jul 11, 2008
Post Count: 161
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: At the risk of asking the obvious, is the validation server overloaded?

Just curious knreed, have we tested multiple images with GPU's? I can't think why it wouldn't work but . . .
----------------------------------------

[Oct 23, 2012 7:55:44 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: At the risk of asking the obvious, is the validation server overloaded?

The GPU was set up to do that since we needed to have a backup plan in case the response was immense (which it has been). We are currently rebuilding the CPU version to support multiple images and we will be moving it through alpha/beta testing in the nearish future.

However, this will simply run 1 image all the way through and then run the 2nd image through. We are not able to 'stagger' them so that one is using the GPU while the other is using the 'CPU'. That would be a very significant re-write of the application. This will reduce the number of 'transactions' that occur between client and server and on the database, but it will not further increase the efficiency of application on your computer - that will remain constant.
[Oct 23, 2012 8:40:47 PM]   Link   Report threatening or abusive post: please login first  Go to top 
branjo
Master Cruncher
Slovakia
Joined: Jun 29, 2012
Post Count: 1892
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: At the risk of asking the obvious, is the validation server overloaded?

kneerd wrote: ...Since we are working on Linux and Mac GPU now ...


Great news hugs
----------------------------------------

Crunching@Home since January 13 2000. Shrubbing@Home since January 5 2006

----------------------------------------
[Edit 1 times, last edit by branjo at Oct 23, 2012 8:42:16 PM]
[Oct 23, 2012 8:41:58 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Movieman
Veteran Cruncher
Joined: Sep 9, 2006
Post Count: 1042
Status: Offline
Reply to this Post  Reply with Quote 
Re: At the risk of asking the obvious, is the validation server overloaded?

Knreed, good info and thanks..
----------------------------------------

[Oct 23, 2012 8:57:38 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 21   Pages: 3   [ 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread