| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
| World Community Grid Forums
|
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 21
|
|
| Author |
|
|
Movieman
Veteran Cruncher Joined: Sep 9, 2006 Post Count: 1042 Status: Offline |
I'm showing 188 pages "pending validation" and it keeps growing.
----------------------------------------Thanks ![]() |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
MM, with 188 PV pages, do a random sampling and click on the WU names to see if the wingman has arrived... no wingman, no validation. Not expecting you to hit the "Try Validation" if it shows when there is a wingman, but then expect it to eventually catch up, no later starting as of a few hours after knreed arrives to the office.
Overloaded... maybe just not enough validators running on HCC [each science has it's own]. Last I read, knreed had added a validator to HCC, so guess there's at least 2 running. At 890,000 results yesterday, it is over 10 per second now. My general observation is that anything I have of Zero redundant, no wingman required, pretty much instantly validates, so as what I said before, think it's FTM confined to HCC if there's backlog. |
||
|
|
pirogue
Veteran Cruncher USA Joined: Dec 8, 2008 Post Count: 685 Status: Offline Project Badges:
|
I've still got some from 10/15 and 10/16 that haven't validated and are still out with a wingman.
----------------------------------------Maybe 7 days is too long of a deadline for WUs that are generally taking far less than an hour. |
||
|
|
Movieman
Veteran Cruncher Joined: Sep 9, 2006 Post Count: 1042 Status: Offline |
MM, with 188 PV pages, do a random sampling and click on the WU names to see if the wingman has arrived... no wingman, no validation. Not expecting you to hit the "Try Validation" if it shows when there is a wingman, but then expect it to eventually catch up, no later starting as of a few hours after knreed arrives to the office. Overloaded... maybe just not enough validators running on HCC [each science has it's own]. Last I read, knreed had added a validator to HCC, so guess there's at least 2 running. At 890,000 results yesterday, it is over 10 per second now. My general observation is that anything I have of Zero redundant, no wingman required, pretty much instantly validates, so as what I said before, think it's FTM confined to HCC if there's backlog. Pretty much what I thought but I had to ask.. Thanks Sek for the info! edit: Down to 140 pages now.. ![]() [Edit 1 times, last edit by Movieman at Oct 22, 2012 5:23:28 PM] |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Pirogue,
Really no idea what the server 700 can handle in terms of different deadline for different resource targets. The 7 days is for the HCC CPU tasks, so that all can participate, even very part-time, so FTM guess it's where the GPU tasks inherited the 7 days. Not getting a wingman back on GPU tasks of the 15/16th... either one considers that in this upstart phase some try out and rubbish a system and try again, without aborting prior to rubbishing, or clients are still not able to prioritize properly. Still reading of cases where one project just wont let others in-between and assert themselves, hogging the resource [short deadline, long running tasks e.g.]. Until someone reports this with details on the WCG support forums of what project combinations show this behavior, can't carry that to techs or developers. |
||
|
|
knreed
Former World Community Grid Tech Joined: Nov 8, 2004 Post Count: 4504 Status: Offline Project Badges:
|
The two validators are keeping up. The long pending validation lists are due to wait times for wingman.
We would like to reduce the 7 day return window except that with the end of CFSW and near end of HCMD2, this is our only 'short' project. If we were to reduce the 7 day return window, there will be more users who cannot return any results within the allowed timeframe. Even thought we want to keep them short, we are going to start putting multiple images into workunits. We are up to 1.3 million results per day and I will get very nervous as we approach 1.5 million results per day. Since we are working on Linux and Mac GPU now and we expect them to contribute a similar boost as Windows, we need to ensure we don't overwhelm the database. Unfortunately, this means pushing the CPU average time out to ~3 hours or so as we put two images into the workunits. In the longer run we are also looking at ways to handle differently sized workunits within the same application. The goal here would be to put 3-4 images in a file for GPU processing and only 1 for CPU users. However there are some challenges involved in that so that will be awhile before we can implement. |
||
|
|
gomeyer
Senior Cruncher USA Joined: Jul 11, 2008 Post Count: 161 Status: Offline Project Badges:
|
Just curious knreed, have we tested multiple images with GPU's? I can't think why it wouldn't work but . . .
----------------------------------------![]() |
||
|
|
knreed
Former World Community Grid Tech Joined: Nov 8, 2004 Post Count: 4504 Status: Offline Project Badges:
|
The GPU was set up to do that since we needed to have a backup plan in case the response was immense (which it has been). We are currently rebuilding the CPU version to support multiple images and we will be moving it through alpha/beta testing in the nearish future.
However, this will simply run 1 image all the way through and then run the 2nd image through. We are not able to 'stagger' them so that one is using the GPU while the other is using the 'CPU'. That would be a very significant re-write of the application. This will reduce the number of 'transactions' that occur between client and server and on the database, but it will not further increase the efficiency of application on your computer - that will remain constant. |
||
|
|
branjo
Master Cruncher Slovakia Joined: Jun 29, 2012 Post Count: 1892 Status: Offline Project Badges:
|
kneerd wrote: ...Since we are working on Linux and Mac GPU now ... Great news ![]() ![]() Crunching@Home since January 13 2000. Shrubbing@Home since January 5 2006 ![]() [Edit 1 times, last edit by branjo at Oct 23, 2012 8:42:16 PM] |
||
|
|
Movieman
Veteran Cruncher Joined: Sep 9, 2006 Post Count: 1042 Status: Offline |
Knreed, good info and thanks..
----------------------------------------![]() |
||
|
|
|