| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
| World Community Grid Forums
|
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 7
|
|
| Author |
|
|
thunder7
Senior Cruncher Netherlands Joined: Mar 6, 2013 Post Count: 241 Status: Offline Project Badges:
|
Is there any script or tool to answer questions like
how much points did I gain in projects X, Y and Z yesterday? did all installations work as expected yesterday? Did the average amount of time / results per day for a certain project move or not? from linux? Wget or curl need to get past the password barrier - anybody solved that? |
||
|
|
thunder7
Senior Cruncher Netherlands Joined: Mar 6, 2013 Post Count: 241 Status: Offline Project Badges:
|
For those who wish to do something like this, this is how I got started:
wget --quiet --save-cookies /tmp/boinc_cookies.txt --keep-session-cookies --post-data 'j_username=thunder7&j_password=wouldntyouliketoknow' https://www.worldcommunitygrid.org/j_security_check -O /tmp/boinc_login.html wget --quiet --load-cookies /tmp/boinc_cookies.txt https://secure.worldcommunitygrid.org/ms/viewMyMemberPage.do -O contribution.html wget --quiet --load-cookies /tmp/boinc_cookies.txt https://secure.worldcommunitygrid.org/ms/device/viewStatisticsByDevice.do -O device_statistics.html |
||
|
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2356 Status: Offline Project Badges:
|
I just wrote a script to download statistics from your "My Contribution" page.
----------------------------------------Many thanks to World Community Grid Tech @knreed for help on this matter (see this posting). This program will read statistics from your "My Contribution" page and output one line containing something like: 2017-04-01 00:06:03 7:274:19:28:31 19,919 17,435,920 8,393 61,289 3,629 10:039:15:59:27 8,314 22,758,229 4,685 70,792 2,906(Date+Time, your Total Run Time+Rank, your Points+Rank, your Results Returned+Rankand for your Team also Total Run Time+Rank, Points+Rank and Results Returned+Rank). If you specify the option -x, the program will output one line with the current statistics for all your WCG-projects along the lines of: 2017-04-01 12:06:02 scc1=0:032:18:25:57=45,445=137 zika=1:188:13:50:25=3,572,290=9,090 hst1=0:059:01:44:44=386,082=211 …(line shortened to fit pagewidth)If you want to save the output to a file on a daily basis, then add one line to your crontab, looking something like this: 27 8 * * * bin/wcgstats >> WCG.stats # Insert the directory where the file WCG.stats will be located. Save the code below to a file called 'wcgstats', chmod +x it and move it to your ~/bin directory. Then change the values of USERNAME=... and PASSWORD=... when/while editing the file to reflect the credentials of your account. --- CUT HERE --- snip 8< --- snip 8< --- snip 8< --- snip 8< --- snip 8< --- snip 8< #!/bin/shTo answer questions like "how much points did I gain in projects X, Y and Z yesterday?" and "Did the average amount of time / results per day for a certain project move or not?" you could use the logfile, "WCG.stats"; the answer to crossing the password barrier is also answered in this script. The question "did all installations work as expected yesterday?" could also be answered by the script 'wcgresults' that can be used to record results that passed the validator. [Edit 5 times, last edit by adriverhoef at Apr 7, 2017 5:58:54 PM] |
||
|
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2356 Status: Offline Project Badges:
|
Here is an updated version of the script that will show the main statistics from your My Contribution page.
What has changed? - Option -c was introduced to remove the comma from numbers > 999 (if needed). - If you haven't joined a team, zeroes will be shown instead of error messages. This program will read statistics from your "My Contribution" page and output one line containing something like: 2017-04-13 12:06:02 0:103:07:20:26 354,018 64,015 544,464 127 586,042 0:207:14:41:52 177,037 128,031 272,928 255 293,084(Date+Time, your Total Run Time+Rank, your Points+Rank, your Results Returned+Rankand for your Team also Total Run Time+Rank, Points+Rank and Results Returned+Rank). If you specify option -x, the program will output one line with the current statistics for all your WCG-projects along the lines of: 2017-04-01 12:06:02 scc1=0:032:18:25:57=45,445=137 zika=1:188:13:50:25=3,572,290=9,090 hst1=0:059:01:44:44=386,082=211 â¦(line shortened to fit pagewidth)If you want to save the output of the program to a file on a daily basis, you could add one line to your crontab, looking something like this: 27 8 * * * bin/wcgstats >> WCG.stats # You might want to insert the directory where the file WCG.stats will be located. Save the code below to a file called 'wcgstats', chmod +x it and move it to your ~/bin directory. Then change the values of USERNAME=... and PASSWORD=... when/while editing the file to reflect the credentials of your account. --- CUT HERE --- snip 8< --- snip 8< --- snip 8< --- snip 8< --- snip 8< --- snip 8< #!/bin/sh |
||
|
|
TonyEllis
Senior Cruncher Australia Joined: Jul 9, 2008 Post Count: 291 Status: Recently Active Project Badges:
|
Thanks adriverhoef for that script...
----------------------------------------by using v1.2 and this command "wcgstats.sh -x -c | tr '\t' '\n' | tr '=' ' ' > /tmp/xxxxx" a nice file like this is created...
This makes it easy to extract the project names and fields required to be graphed using mrtg and added to my web-site The end result here... http://www.sraellis.tk/frame-17-wcg_progress.html
Run Time Stats https://grassmere-productions.no-ip.biz/
|
||
|
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2356 Status: Offline Project Badges:
|
It's very nice to hear that you like it, Tony.
And if you want to make use of only one 'tr' command, you could even write it like this: wcgstats -x -c | tr '\t=' '\n ' (Japanese wizkid?)By using mrtg everyone can see something's growing on your machine ... Awesome! (I've never used mrtg) |
||
|
|
TonyEllis
Senior Cruncher Australia Joined: Jul 9, 2008 Post Count: 291 Status: Recently Active Project Badges:
|
Thanks adriverhoef - have applied your 'tr' hint. Here in Australia the daily statistics updates happens around midday - that just happened to be when your post was seen and I copied and pasted your script - took me a few seconds to realize why it was failing
---------------------------------------- - needed to be patient for the WCG batch job to finish before being able to progress with this little project ![]()
Run Time Stats https://grassmere-productions.no-ip.biz/
----------------------------------------[Edit 1 times, last edit by TonyEllis at Apr 14, 2017 9:37:23 AM] |
||
|
|
|