| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
| World Community Grid Forums
|
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 89
|
|
| Author |
|
|
wplachy
Senior Cruncher Joined: Sep 4, 2007 Post Count: 423 Status: Offline |
I'm parsing the HTML to pull from the "MY CONTRIBUTION", "Global Statistics" and "Results Status" pages. The data I'm pulling from these pages is everything but the headings, graphics and links. I'm also pulling data from the Member and Team Statistics pages using &xml=true. For the "My Contribution" stats - how come you don't use: http://www.worldcommunitygrid.org/help/viewTopic.do?shortName=profile#335 ?) I didn't know it existed. I'll change my capture logic to use that.If I were to make available something similar to the verification url but that would return data from the result status page, would you use that instead of scrapping the results status page? I'm thinking something like: http://www.worldcommunitygrid.org/verifyMembe...amp;code=VERIFICATIONCODE with optional parameters for project status of result (valid, invalid, pending verification, pending validation, etc) What I'm pulling from the Results Status pages are: Result Name, Device Name, Status, Sent Time, Due/Return Time, CPU/Elapsed Time and Claimed/Granted Credit. If it would return that information I would absolutly use it. Thank you!!
Bill P
![]() |
||
|
|
jonnieb-uk
Ace Cruncher England Joined: Nov 30, 2011 Post Count: 6105 Status: Offline Project Badges:
|
Emphasis on the 'if' Before I build, I wanted to make sure it was what you need.Yes that's it exactly. I'm unimportant but I think that SNURK would be very happy if the time could be found to build. ![]() |
||
|
|
SNURK
Veteran Cruncher The Netherlands Joined: Nov 26, 2007 Post Count: 1217 Status: Offline Project Badges:
|
If you had http://www.worldcommunitygrid.org/stat/viewCo...untryCode=GB&xml=true http://www.worldcommunitygrid.org/stat/viewCo...untryCode=GB&xml=true (sort could be any of cpu, points or results) http://www.worldcommunitygrid.org/stat/viewCo...untryCode=GB&xml=true (sort could be any of cpu, points or results) Would that meet your needs? That would get my thumbs up too!! ![]() |
||
|
|
pirogue
Veteran Cruncher USA Joined: Dec 8, 2008 Post Count: 685 Status: Offline Project Badges:
|
If I were to make available something similar to the verification url but that would return data from the result status page, would you use that instead of scrapping the results status page? I'm thinking something like: http://www.worldcommunitygrid.org/verifyMembe...amp;code=VERIFICATIONCODE with optional parameters for project status of result (valid, invalid, pending verification, pending validation, etc) That would work. It might also be nice to have something like &changedafter=TIMESTAMP and only receive WUs that had a status change after that date/time. |
||
|
|
wplachy
Senior Cruncher Joined: Sep 4, 2007 Post Count: 423 Status: Offline |
If I were to make available something similar to the verification url but that would return data from the result status page, would you use that instead of scrapping the results status page? I'm thinking something like: http://www.worldcommunitygrid.org/verifyMembe...amp;code=VERIFICATIONCODE with optional parameters for project status of result (valid, invalid, pending verification, pending validation, etc) That would work. It might also be nice to have something like &changedafter=TIMESTAMP and only receive WUs that had a status change after that date/time. +1 here. Would save having to look at all results. Not required by me, but as long as we're compiling as wish list... ![]()
Bill P
![]() |
||
|
|
KerSamson
Master Cruncher Switzerland Joined: Jan 29, 2007 Post Count: 1684 Status: Offline Project Badges:
|
Hi guys,
----------------------------------------after some weeks business travelling, I am back and I would like to bring my small contribution to this hot topic.
I have currently three master students working on a project for developing a contribution monitoring tool (in the meaning of WCGDAWS). This tool should be a web tool grabbing the results automatically (twice of three time daily) for a specific member (not for all members), generating reports and making the information available other a web site. Additionally - if the project progress allows it - an automated alarming system over e-mail should inform the user if some performance problems occur for a specific host, e.g.: too many invalid or errored results, no work available, etc. We did already a try last year but unfortunately the project was not completed as expected. I hope that the current re-design activities of WCG web site will not impact too negatively the progress of this project. Cheers, Yves --- PS: If some members are interested to contribute by defining expectations for data connectors, I could volunteer for writing down the requirements within the scope of a collaborative work. -- PPS: If some members are interested by the contribution monitoring tool, please let me know. I hope that we could have a reasonable and operating result until year end. |
||
|
|
Tullus
Cruncher Joined: Nov 14, 2008 Post Count: 29 Status: Offline Project Badges:
|
Hi KerSamson, have you seen my open source project:
https://code.google.com/p/py-boinc-plotter/ Feel free to glance over the feature page (which is slightly outdated at the moment): https://code.google.com/p/py-boinc-plotter/wiki/Features I think it can be used as a starting point for your monitoring tool. Feel free to discuss any issues on the google code issue site, or send me an email. |
||
|
|
KerSamson
Master Cruncher Switzerland Joined: Jan 29, 2007 Post Count: 1684 Status: Offline Project Badges:
|
Hi Tullus,
----------------------------------------I thank you for the information. We will take a look on your project and we will consider if we can integrate part of it in ours. I will keep you inform. However, we have only a limited time for elaborating a runnable solution. Cheers, Yves |
||
|
|
widdershins
Veteran Cruncher Scotland Joined: Apr 30, 2007 Post Count: 677 Status: Offline Project Badges:
|
Hi KerSamson
I'd be interested in trying your monitoring tool when it's available, it sounds interesting. Thanks for developing it |
||
|
|
Tullus
Cruncher Joined: Nov 14, 2008 Post Count: 29 Status: Offline Project Badges:
|
Any progress on the xml task list?
----------------------------------------I would like to point out this: http://boinc.berkeley.edu/trac/wiki/WebRpc#pending If the "Get result list with pending credit" could be extended to "Get results" and the reply also contains: Application name/Project Name, Result Name, Device Name, Status, Sent Time, Time Due, Return Time, CPU Time/Elapsed Time, Claimed, Granted BOINC Credit that would be fantastic (and feel free to pour in any other data you might have about the task, we like data). The structure might look something like this (note: not completely backward compatible with pending.php, so should add a new call, say "user_results.php"):
And please do share the addition with the rest of the boinc community. [Edit 1 times, last edit by Tullus at Dec 3, 2013 8:11:53 PM] |
||
|
|
|