Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 9
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1506 times and has 8 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
A little request and question

Hi,
I've been working on "Team 2ch" as a analyzer, and making diary reports for our team members.
I have a problems regarding on your webpages, the file on http://www.worldcommunitygrid.org/boinc/stats/user.gz is lack of some information, like total analyzing time and rate of job uploads etc.
So, I have been trying getting those datas from individual pages via XML.
But the thing is, I am getting "500 Internal Server Error" response lately, and I haven't getting good results as I expected.
Furthermore, sometimes I get the messages saying "We no longer offer you an information for your requests", and also it takes so much time to compiling the
datas and I am not able to finish up before the next updates recently.

With those, I am worrying about that I might causing a heavy work load on your web server, and I could be blocked from your webpages which I really don't want to that happen.
And as a result, I wouldn't be able to provide dairy report for people who is joing on "Team 2ch", and it would be affect to our team members.
(This diary reports help our team meber's motivations to keep high)

So I want to know if there is the more smoother way to get those information from your server, or would you be
able to provide more smoother way to get those informations?
Even adding "Total analyzing time" and "Rate of job uploads" datas to www.worldcommunitygrid.org/boinc/stats/user.gz is OK.
Thanks,

Sincerely

Nippotu
Team 2ch
[Jul 19, 2008 4:15:57 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: A little request and question

Hi, Nippotu.

You can get the individual user data faster if you get multiple users at once.

Multiple member comparison

I'm not sure how many users you can get at once. At least 8, maybe more.
[Jul 19, 2008 4:38:40 AM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: A little request and question

I'm not sure how many users you can get at once. At least 8, maybe more.

I have just tried. Not more, but 8 yes.

Cheers. Jean.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Jul 19, 2008 3:20:42 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: A little request and question

Thanks for the quick replies smile
I also have tried the code which Didactylos showed to me, but unfortunately when I tried more than 8, it turns out to error.
The range between "userNames[0].value" to "userNames[7].value" works, but when "userNames[8].value" it stops.

Our team has 7000+ members, and if I use that code, I have to access to there for almost 1000 times and thats nonsense...

Does anyone knows more better solutions?
[Jul 19, 2008 8:48:49 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: A little request and question

In a little while WCG will fully convert to reporting BOINC credits instead of WCG points. I imagine you'd be able to pull the user and team standing same as e.g. BOINCstats do, with the addition of results and runtime. They do it without fail from whatever export file that is provided daily by WCG.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jul 19, 2008 9:05:05 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: A little request and question

In a little while WCG will fully convert to reporting BOINC credits instead of WCG points. I imagine you'd be able to pull the user and team standing same as e.g. BOINCstats do, with the addition of results and runtime. They do it without fail from whatever export file that is provided daily by WCG.


Ok thanks, I am looking forward for it smile
[Jul 21, 2008 11:18:48 AM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: A little request and question

The user.gz file will never have # of results and cpu time though (I'm assuming this is the analyzing time value you wanted) since that information isn't tracked by BOINC (and the user.gz file is a BOINC file)

Our website database is heavily loaded as this time. We are working on both moving it from DB2 7.2 to DB2 9.5 as well as giving it three times more RAM. It might be a 2-3 months before this is finished, but after that we expect to see much better performance and the number of times people get errors looking at or pulling various stats should be significantly reduced.
[Jul 21, 2008 5:15:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: A little request and question

Just remembered that I pulled for a team challenge in 2007 the "by member" cumulative stats for all 600 members in 1 go off the Team member list that you can pick by results, points, runtime. By dumping and running a compare prior day, current day it pulled and computed the daily production per member too. The standard is maximum 250 members per page, but changing the URL directly you can pull at least 999. Stats is running this moment so can't test if a larger number is permitted. The page refresh usually lasted about 15-30 seconds.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jul 23, 2008 1:37:36 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
smile Re: A little request and question

Okay, it seems that post Stats Update it takes quite a while to build more indices so it ran a few minutes to get the initial first 50 listed, but after some more refreshes, the top 999 came up in about 1.5 minutes.

http://www.worldcommunitygrid.org/team/viewTe...amp;numRecordsPerPage=999

After i tried with 1999 and that took another 3minute+ before a "application not available" popped up. Time out i suppose. Don't know if that can be extended. BUT, on a refresh it did list 1999 members and took just 30 seconds.

Now the ?xml=true or &xml=true suffix if that works and is wanted, but a quick copy paste into a spreadsheet provided all the values in tabular fashion.

[Added: Went overboard and after trying 3999 went for the full 8097 which came up in 2 minutes and took a minute to build the page. It's as if the WCG site needs to warm up to these supersized queries.]

let us know
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
----------------------------------------
[Edit 3 times, last edit by Sekerob at Jul 23, 2008 4:02:18 AM]
[Jul 23, 2008 3:46:51 AM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread