Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 
World Community Grid Forums
  Category: Support
  Forum: Suggestions / Feedback
  Thread: WCG Stats XML file not updating

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 10
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1670 times and has 9 replies Next Thread
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2494
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
WCG Stats XML file not updating
The WCG Host XML stats file, hasn't updated for over 5 days now, according to BoincStats
https://www.boincstats.com/stats/15/project/detail/

From the above included BoincStats page:
Last update user XML 2024-11-08 00:24:15 UTC (14:23:09 old)
Last update host XML 2024-11-03 12:26:11 UTC (5 days 02:21:13 old)
Last update team XML 2024-11-08 00:24:15 UTC (14:23:09 old)
----------------------------------------
[Edit 1 times, last edit by Grumpy Swede at Nov 8, 2024 5:37:01 PM]
[Nov 8, 2024 5:33:46 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG Stats XML file not updating
It's possible that they (Boincstats) fail to establish a valid connection (resulting in e.g. 503: Service unavailable), since the files are there with Last modification time dated 2024-11-08. Sometimes I get a valid connection:

[ ]	host.gz 	2024-11-08 13:23 	681M	 
[ ]	host.xml.gz 	2024-11-08 13:23 	681M	 
[ ]	host_deleted.gz 	2024-11-08 13:26 	91K	 
[ ]	host_deleted.xml.gz 	2024-11-08 13:26 	91K	 
[DIR]	stats/ 	2024-11-08 13:26 	- 	 
[DIR]	stats_2024_11_7_1_21..>	2024-11-06 19:22 	- 	 
[DIR]	stats_2024_11_7_13_2..>	2024-11-07 01:21 	- 	 
[DIR]	stats_2024_11_7_19_2..>	2024-11-07 13:21 	- 	 
[DIR]	stats_2024_11_8_1_24..>	2024-11-07 19:23 	- 	 
[DIR]	stats_2024_11_8_13_2..>	2024-11-08 01:24 	- 	 
[TXT]	tables.xml 	2024-11-08 13:26 	6.4K	 
[ ]	team.gz 	2024-11-08 12:16 	2.6M	 
[ ]	team.xml.gz 	2024-11-08 12:16 	2.6M	 
[ ]	user.gz 	2024-11-08 12:16 	3.8M	 
[ ]	user.xml.gz 	2024-11-08 12:16 	3.8M


Other times I get:
503 Service Unavailable

No server is available to handle this request.

Adri
[Nov 8, 2024 6:05:38 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2494
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG Stats XML file not updating
@adriverhoef

Yeah, I also noticed the 503 error, when I tried to reach the WCG stats URL. I never managed to connect. I was getting the 503 error every time.
[Nov 8, 2024 6:21:33 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Bryn Mawr
Senior Cruncher
Joined: Dec 26, 2018
Post Count: 384
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG Stats XML file not updating
I don’t get much credit per day on BoincStats but then, with the comms problems, I’m not doing much work but I have received some credit every day so BS must be updating at least partially.
----------------------------------------
[Edit 1 times, last edit by Bryn Mawr at Nov 8, 2024 11:28:17 PM]
[Nov 8, 2024 11:27:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG Stats XML file not updating
My daily points at BOINCstats have dropped a bit since the restart of ARP1 a week ago, but there seem to have been proper daily external stats updates as far as I can tell... confused

That drop in points looks at least consistent with some hosts temporarily running out of MCM1 WUs due to the download/upload issues and due to majority of my returned ARP1 WUs still waiting to be validated.

Ralf
[Nov 9, 2024 4:26:18 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Garrulus glandarius
Advanced Cruncher
Romania
Joined: Apr 10, 2025
Post Count: 88
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG Stats XML file not updating
Still no update since August 29-30, meaning no updates to signatures either. Is the problem on WCG's end (not exporting stats)?
----------------------------------------
[Nov 4, 2025 6:47:13 AM]   Link   Report threatening or abusive post: please login first  Go to top 
MJH333
Senior Cruncher
England
Joined: Apr 3, 2021
Post Count: 300
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG Stats XML file not updating
Still no update since August 29-30, meaning no updates to signatures either. Is the problem on WCG's end (not exporting stats)?
Yes, I think the problem is at WCG's end. They are upgrading the old IBM system to a modern containerised system, and they are focusing on getting the main production bits of the system going before the other bits like stats export.
At least, that's my non-technical understanding of what's going on! smile
Cheers,
Mark
[Nov 4, 2025 9:46:22 AM]   Link   Report threatening or abusive post: please login first  Go to top 
dylanht
World Community Grid Tech
Joined: Jul 1, 2021
Post Count: 35
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG Stats XML file not updating
Indeed it is an issue on our end. We are not yet running the db_dump utility to produce those files daily. I initially planned to start running that job again at the same time as I re-enabled the website stats update, but as others have pointed out I do not yet consider the MCM1 workunit processing backend quite stable, but I will "soon" reschedule the db_dump of stats to https://download.worldcommunitygrid.org/boinc/stats/

Side note, the full root disks (my fault, left an individual workunit log level set in the new assimilators, and did not setup log rotation for that container or apache2) causing the file_upload_handler pool to get into an unhealthy state and apache to report 503 because it can't get them to handle uploads through the socket shared between host and container was causing HTTP transient errors on those partitions, should now be fixed after a few attempts to triage and fix the problem were not sufficient.
[Nov 4, 2025 4:42:45 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Garrulus glandarius
Advanced Cruncher
Romania
Joined: Apr 10, 2025
Post Count: 88
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG Stats XML file not updating
Thanks for the update Dylan, keep up the good work on all fronts!
----------------------------------------
[Nov 4, 2025 4:49:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
jwaggy
Cruncher
Joined: Jul 2, 2018
Post Count: 2
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WCG Stats XML file not updating
It looks like the stats are still not updating. Do you know if this will be reenabled soon?
[Dec 5, 2025 12:25:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread