| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Support
Forum: Website Support
Thread: Screen Scrapers - Please Discuss |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 89
|
|
| Author |
|
|
johncmacalister2010@gmail.com
Veteran Cruncher Canada Joined: Nov 16, 2010 Post Count: 799 Status: Offline Project Badges: 
|
Summary
----------------------------------------As we move toward our second decade of supporting humanitarian research, we're excited to introduce a more approachable and welcoming World Community Grid, as well as a new software application available for upgrade. Thanks: I find the new GUI much fresher and easy to use. Good stuff  We rolled out the first change of the changes to our website that we are going to be frequently doing over the next 3-6 months. The HTML structure is going to be changing a fair amount as we do this rework and screen scraping will not be a reliable way to access data on an ongoing basis during this work stream. I'd like to hear from those people who are doing screen scraping and let us know what you are doing and what data you are going after and we can see what we can do to help you let your tools remain stable during these changes. There are lot of coments, from other people, abourt many changes. Will contribute with a small one, but important fro me (of course !). I noted in the initial page (old MY GRID page, now MY Statitics page...) that is difficult to acess the device manager and the device profiles, once there isn't more a link to do it... I think that it's a very helpful link for all crunchers and need be there. Now to acess it we need walk many steps... Think about please.   crunching, crunching, crunching. AMD Ryzen 5 2600 6-core Processor with Windows 11 64 Pro. AMD Ryzen 7 3700X 8-Core Processor with Windows 11 64 Pro (part time)  |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
My private xml processing concoction spat out a validation state 3 with a question mark for result of FAHV_x3NF8_B_IN_FBPa_rig_0211458_2599_5 . When looking in the api help item at https://secure.worldcommunitygrid.org/help/viewSearch.do?searchString=api , there's no state 3 given, skipping from 2 to 4. From looking at the result status page, the result was given a 'too late'.
----------------------------------------FAHV_ x3NF8_ B_ IN_ FBPa_ rig_ 0211458_ 2599_ 5-- android_fcbcf39 e Too Late 4/21/14 14:56:00 4/21/14 19:25:49 3.73 / 3.95 21.8 / 21.8 Could you please update the help item and add missing code and any other missing codes, if there are. Since some codes only tell their exact status in combination with other flags, this one having an outcome of 1, being success, the description could very well be something like '3 means redundant to requirement', but 'too late' it was given, taken out of circulation due too many errors, having converted from an original 'validate state' of 0, pending validation. [Edit 1 times, last edit by Former Member at May 2, 2014 3:26:42 PM] |
||
|
|
Tullus
Cruncher Joined: Nov 14, 2008 Post Count: 29 Status: Offline Project Badges:
|
Thank you lavaflow! I was wondering about the ommision of state 3 myself. Good to know it means "too late". Hopefully the omission will be fixed in the faq.
|
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Don't mention it, but was careful since there's also a state '5 means results failed to validate within given deadline.' which I do not know what that then refers to, while attempting to translate the various state combinations to the ones as is shown on the result status pages. Is the 5 the 'waiting to send' or the occasional 'other'? Scraping text was easier in that respect, leaving no doubt.
 |
||
|
|
uplinger
Former World Community Grid Tech Joined: May 23, 2005 Post Count: 3952 Status: Offline Project Badges: 
|
Validate state 3 is actually one that doesn't get hit very often. Basically if the work unit was set to error, usually meaning too many errors came back, then a No Check will be issued for a wingman after a work unit has been labeled as error. You can look at what all the field values are by looking at this page:
http://boinc.berkeley.edu/trac/wiki/BackendState Thanks, -Uplinger |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Ok, then maybe the descriptor on the result status page could be renamed as something like Too many winman errors'. Credit is granted as claimed, though when claimed is removed, there seem to be plans of that, how would a grant be awarded? Based on present device credit per second statistic?
----------------------------------------P.s, rarely hit but see way too many on android that are hitting 10 errors. Got some apiecing stats for us? Did you indicate the error number would be reduced before circulation abort? Since never ever seing this on linux, running fahv exclusive, previously suggested to then stop these from going to android earlier and have another platform give it a go. [Edit 2 times, last edit by Former Member at May 7, 2014 7:41:50 PM] |
||
|
|
Tullus
Cruncher Joined: Nov 14, 2008 Post Count: 29 Status: Offline Project Badges:
|
Edit: Vops seems to already been reported
----------------------------------------http://www.worldcommunitygrid.org/forums/wcg/viewthread_thread,36858 Hi! Just saw the new badges. Would you mind correcting the "title" tag for the new badges? This is what I currently use to scrape the badge state. But is a nice feature for volunteers to actually find the meaning of the badges when hovering the mouse of the badges. For instance, uplinger has: <img src="/images/pb/dddt_5.jpg" title="Sapphire Level Badge (2 years) for Discovering Dengue Drugs - Together" alt="" /> in the old badge system, but newer badges has only: <img src="/images/pb/faah_9.jpg" title="FightAIDS@Home" alt="" /> i.e. missing the description "Diamond Level Badge (50 years) for FightAIDS@Home" Of course I use the xml interface for scraping, so not sure what that will display, but I am guessing it is the same. Great addition btw! Let us know if it increases contributions. [Edit 1 times, last edit by Tullus at May 30, 2014 9:51:02 AM] |
||
|
|
deltavee
Ace Cruncher Texas Hill Country Joined: Nov 17, 2004 Post Count: 4894 Status: Offline Project Badges: 
|
On My Contribution, Statistics by Project, the row for Say No to Schistosoma has been moved down two places.
|
||
|
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
Interesting, official BOINC RPC for getting result statuses, albeit it is somewhat different to the API of WCG, which is kind of 'of course, is there anything interface wise that's standard compared to BOINC?'. For instance the device profiles... try matching those with the 7.6 local computing preferences and y'all be busy for a while ;P)
Check-In: Add web RPC for getting status of results, https://github.com/BOINC/boinc/commit/8300b08968570b2ec942af9daa550110cd71e1ce |
|||
|
||||
|
|