Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 3
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 750 times and has 2 replies Next Thread
wplachy
Senior Cruncher
Joined: Sep 4, 2007
Post Count: 423
Status: Offline
Reply to this Post  Reply with Quote 
Method to Capture Results Status

Is there a way to capture my current Results Status in a single page, or better yet in a single capture file (text, xml, etc)?

I built a database that tracks project, device, CPU time, status and points that I use to evaluate projects processed, device performance, etc. The way I have been capturing this is that each day I have been displaying my results status and then capturing each page as a single file Web Archive. I then use a program I wrote to read each file and load it to the db.

My problem is that my daily results run between 50-60 pages and it takes about 20 minutes to display and capture each page. Given that nightly stats don't complete until about 9:30 PM my time it makes for a long night.

Can anyone tell me of a way to capture all "pages" as either a single web page, or to a file on my PC?

Thank you in advance to anyone providing assistance!
----------------------------------------
Bill P

[Sep 18, 2008 3:33:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Method to Capture Results Status

Finger on the pulse, eyes wide open, stay tuned, subscribe to member news RSS feed as something is in preparation to make parts of the statistics capturing easier. Not sure if XML for the RS pages is included in the upcoming website update.

Without having XML, I've done it and set up a query directly into Open Office Calc, 25 tabs, each tab picking up a page, and it's retrieved in under a minutes, in your case saving 19 minutes. It was just a proof of concept, the next link from page the query that dumps page 6 into tab 6, sorted by newest to oldest result:

https://secure.worldcommunitygrid.org/ms/view...rojectId=-1&pageNum=6

cheers

PS, pages that do not exist simply go blank.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Sep 18, 2008 4:41:11 PM]   Link   Report threatening or abusive post: please login first  Go to top 
wplachy
Senior Cruncher
Joined: Sep 4, 2007
Post Count: 423
Status: Offline
Reply to this Post  Reply with Quote 
Re: Method to Capture Results Status

Sekerob,

Thank you for the response! I'll try your proof of concept as soon as results are available tonight.
----------------------------------------
Bill P

[Sep 19, 2008 12:45:38 AM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread