Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 8
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1157 times and has 7 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
XML stat error

Hi, I am currently retrieving individual user stats using the XML feed, for a stat image generator (http://dcstat.com), and have been receiving error messages instead of stats. It seems to work correctly for about 1 out of ever 12ish users. This hasn't started happening until recently. I was wondering what may be causing the error messages?

<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0">
<channel>
<title>World Community Grid - Error</title>
<link>http://www.worldcommunitygrid.org</link>
<description>An error occurred processing the feed.</description>
<language>en-us</language>
<webMaster>support@worldcommunitygrid.org</webMaster>
<item>
<title>Error</title>
<description/>
<link>http://www.worldcommunitygrid.org</link>
</item>
</channel>
</rss>


Here is the link I am using (changing the username for the current user being updated of course): http://www.worldcommunitygrid.org/rss?feed=member&userName=mousie


At first I thought maybe it was flooding the server with requests, though it is throttled down to 1 request about every 10 seconds, if I recall correctly....and that error message is usually something along the lines of "too many requests in a short time" for that. I guess it's possible I'm updating my stats at the same time stats are updating here, causing the errors, though I would have expected ALL users to be affected if that were true, though that isn't the case.

Any ideas why I am seeing the above error?
[Jan 19, 2008 4:44:04 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: XML stat error

Just ran stat update again manually, and I don't seem to be seeing errors now. I'll try changing my update times to see if that does the trick thinking
[Jan 19, 2008 5:10:04 AM]   Link   Report threatening or abusive post: please login first  Go to top 
keithhenry
Ace Cruncher
Senile old farts of the world ....uh.....uh..... nevermind
Joined: Nov 18, 2004
Post Count: 18667
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: XML stat error

You know Mousie, the "behavior" I see now during the time the stats are updating has changed. In fact, something may be wrong with it too. Before, about 5-8 minutes after 00:00 and 12:00 UTC, you'd start getting the "stats are updating, completion in xx:xx" message. That would last about 60 to 90 minutes and then you'd get to the updated stats. Now, I don't start seeing the stats updating message until 15-20 minutes after and the time usually starts out at about an hour. At that point, the time remaining in the message starts over again. About 30-45 minutes later, it suddenly goes to 00:00 for a while and then you finally see the new stats. Net is where the update time usually took 60-90 minutes before, now it's more like 120-150 minutes. I want to think the behavior changed between Thanksgiving and Christmas, at least that's when I started to really notice the difference but it could go back to the last time change. I've wondered if it was just taking longer due to more data to crunch or if there's something really wrong. I've tended towards the former simply because I'd expect that the admins would have noticed that something was wrong long before now if there really was a problem.
----------------------------------------
Join/Website/IMODB



[Jan 20, 2008 2:34:18 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: XML stat error

It is kinda strange, the difference in update times...as in the past, I didn't have issues with the schedule I had set up to run my stat updates - verses now it seems like it collides with WCG's update times. This is just recently that this has happened.......if you recall when people first started seeing this recent hiccup in their stat images - I would guess that's about the time the changes happened.
[Jan 20, 2008 4:55:22 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: XML stat error

plz see latest updates to the Scheduling post in the Start Here forum. Particular the Saturday midday tends to roll over several times as its when database optimisations are run. Updates are supposed to start 6 minutes after 00:00 and 12:00 UTC, but at times it seems the kick-offs are left to slide a bit after tweaking work, probably in case speeds of one or the other step works out adversely. At least it finishes, which is the important part.

As for stats in XML, a bunch more formats became available bout a week ago. Please see Member news with a link thru to a FAQ explaining the parts.

PS, think the 59:59 minutes is a legacy thing. If it does not manage to finish as in the past within 60 minutes, it starts counting again from the top. Sometimes i see e.g. 38 minutes left and 2 minutes later it's done.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
----------------------------------------
[Edit 1 times, last edit by Sekerob at Jan 20, 2008 5:08:32 PM]
[Jan 20, 2008 5:06:29 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: XML stat error

A couple of quick notes:

1) The 'start' of the stats update process is always 6 minutes after 0:00, 12:00. However, the site is not marked 'unavailable' until it has finished extracting the data from both the UD grid database and the BOINC grid database. In particular, extract the last result time from the BOINC database takes awhile to extract. This causes a variable delay in when the site is marked unavailable.

2) The time that the website is unavailable due to running stats is a little over 40 minutes for the mid-day update and about an 1 and 40 minutes for the end of day stats update.

3) The countdown timer is currently broken. But good news! We fixed it on Friday and it will be put into production later this week or start of next.


mousie,

If you are continuing to see those periodic errors, please use the contact us option to send a message to us (I will want to find out at what times and ip address your are fetching the data from and other such details so that I can look at what happened). Just reference this thread and ask to have it sent to Kevin. We have not currently put a throttle on the XML interfaces (and hopefully we will not have to) so that shouldn't be the problem (unless your are using the old RSS stats feeds).

thanks,
Kevin
[Jan 21, 2008 6:39:43 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: XML stat error

Thanks Kevin, I'll keep an eye open in case I see it again.
[Jan 22, 2008 1:28:10 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: XML stat error

You know Mousie, the "behavior" I see now during the time the stats are updating has changed. In fact, something may be wrong with it too. Before, about 5-8 minutes after 00:00 and 12:00 UTC, you'd start getting the "stats are updating, completion in xx:xx" message. That would last about 60 to 90 minutes and then you'd get to the updated stats. Now, I don't start seeing the stats updating message until 15-20 minutes after and the time usually starts out at about an hour. At that point, the time remaining in the message starts over again. About 30-45 minutes later, it suddenly goes to 00:00 for a while and then you finally see the new stats. Net is where the update time usually took 60-90 minutes before, now it's more like 120-150 minutes. I want to think the behavior changed between Thanksgiving and Christmas, at least that's when I started to really notice the difference but it could go back to the last time change. I've wondered if it was just taking longer due to more data to crunch or if there's something really wrong. I've tended towards the former simply because I'd expect that the admins would have noticed that something was wrong long before now if there really was a problem.

The predicted "time to go" fix is going into production on January 29, 2008
From admin:
"• Bug fix Stats update time remaining should now behave correctly and be more accurate (and have an xml version as well)"
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jan 29, 2008 10:04:24 AM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread