Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 1
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1215 times and has 0 replies Next Thread
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Anything in the works to end the scraping needs of members?

It's not a need, rather a 'must' to scrape various My Contribution sub-pages, which again this morning slapped me in the face. 'So happens' (David Carradine uses these 2 words quite a few times in his role as Bill), this morning I loaded a second Excel app, that set the separators back to decimal comma, thousand separator point, when it is required to be in point comma when scraping e.g. My Statistics History and Device Stats (There's a third one but momentarily escapes me). Has to be as any number greater than 999 will get misinterpreted as having a fraction so e.g. 1,999 arrives as 1.999 until hitting the million results/points, where the value gets imported as text, or weirder, the commas get all put at the end so for 1,234,567,890 at times shows up as 1234567890,,,.

Somewhere over a year ago we discussed the 3 particular MC pages for which we'd like xml pull ability by suffixing the web address with ?xml=true, but just trying, it's still no go (tried in vain, as surely this would have been advertised as implemented). More importantly, do away for those pages with the need to sign in before scraping and use http://www.worldcommunitygrid.org/verifyMember.do?name=MEMBERNAME&code=VERIFICATIONCODE features as can be used for the main MC page pulls.

Any progress on this long standing matter?

Thx
[Sep 13, 2016 8:30:12 AM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread