| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Support
Forum: Website Support
Thread: Stats late... |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 161
|
|
| Author |
|
|
Seoulpowergrid
Veteran Cruncher Joined: Apr 12, 2013 Post Count: 823 Status: Offline Project Badges: 
|
The stats normally update right as I am arriving at the office local time but these days are finishing around 2 PM. It's almost 3 and it's locked at 0 minutes remaining. I'll check it again before I go home.
---------------------------------------- |
||
|
|
TPCBF
Master Cruncher USA Joined: Jan 2, 2011 Post Count: 2173 Status: Offline Project Badges: 
|
Looks like things are getting worse right now. It's almost 11pm PST (normal cutoff is 5pm PST and the stats run was usually done by 6pm) and it still isn't updating the stats and results web sites.
Ralf  |
||
|
|
BladeD
Ace Cruncher USA Joined: Nov 17, 2004 Post Count: 28976 Status: Offline Project Badges: 
|
Statistics Last Updated: 5/17/19 00:06:03 (UTC) [8 hour(s) ago] Finally...  |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Even the script to scrape took 4:38 hours to come back with blank pages. Something is massively busy in some loop or race for resource... to a cloud may be in China.
----------------------------------------[Edit 1 times, last edit by Former Member at May 17, 2019 12:08:36 PM] |
||
|
|
uplinger
Former World Community Grid Tech Joined: May 23, 2005 Post Count: 3952 Status: Offline Project Badges: 
|
We have a change request open with our hosting environment to increase our storage IO. It appears that even with loading more into memory, we are still hitting the IO limits on the database storage.
Thanks, -Uplinger |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Consider creating space by removing devices that have a Results Returned: Never. On 6 million or so there could be hundreds of thousands.
|
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
One other thought related to the API result extractions. Recently learned these were expanded from 250-500 max per call to unlimited. Is there some pile up during the nightly of these requests? Just tested, and even getting 40 takes momentarily over a minute, sometimes several minutes.
|
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Just tested, and even getting 40 takes momentarily over a minute, sometimes several minutes. Hi @lavaflow - that's interesting. I've not experienced that in the nearly two months since I started gathering statistics. My request from the API using limit of 0 along with all the post processing and data inserts into MySQL takes roughly 9 seconds for about 1600 records. I just ran it to test and this was the result: time sh ./wcg_api_new.sh -l real 0m8.753s user 0m4.921s sys 0m2.943s This has been consistent for two months regardless of the time it takes for the stats to run. API requests are made ad hoc so they shouldn't be affecting the stats as you can't call the API while the stats are running. Best, -mark |
||
|
|
BladeD
Ace Cruncher USA Joined: Nov 17, 2004 Post Count: 28976 Status: Offline Project Badges:
|
The page you requested is currently unavailable because the statistics are being updated.
----------------------------------------The statistics update will finish in about 76 minutes 2 seconds . |
||
|
|
TLD
Veteran Cruncher USA Joined: Jul 22, 2005 Post Count: 856 Status: Offline Project Badges: 
|
The page you requested is currently unavailable because the statistics are being updated.
----------------------------------------The statistics update will finish in about 0 minutes 0 seconds .  |
||
|
|
|