| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Support
Forum: Website Support
Thread: Trouble getting the xml stats files |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 11
|
|
| Author |
|
|
Bok7575
Advanced Cruncher Joined: Jul 8, 2008 Post Count: 51 Status: Offline Project Badges: 
|
For the past few days my stats scripts have not been able to successfully download the files at all. This is for stats.free-dc.org
I use the perl LWP libraries and all was working till midday on the 19th June. Now it downloads the files but they are always corrupted. Same for either the http location or the https one. If I try a manual wget It's similar [root@web3 ~]# wget http://www.worldcommunitygrid.org/boinc/stats/team.gz --2016-06-22 08:20:22-- http://www.worldcommunitygrid.org/boinc/stats/team.gz Resolving www.worldcommunitygrid.org... 198.20.8.246 Connecting to www.worldcommunitygrid.org|198.20.8.246|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 2564914 (2.4M) [text/plain] Saving to: “team.gz” 100%[====================================>] 2,564,914 594K/s in 4.2s 2016-06-22 08:20:26 (594 KB/s) - “team.gz” saved [2564914/2564914] [root@web3 ~]# gzip -d team.gz gzip: team.gz: invalid compressed data--crc error gzip: team.gz: invalid compressed data--length error And I can't even download them in a browser. Every other project is working fine and I tried from an external machine and that worked ok. So is this somehow my IP address being blacklisted on the WCG end ? Any ideas? |
||
|
|
Eric_Kaiser
Veteran Cruncher Germany (Hessen) Joined: May 7, 2013 Post Count: 1047 Status: Offline Project Badges: 
|
I put the url you've mentioned in my browser (firefox) and to my surprise it is not gzipped.
----------------------------------------I can see the xml in plain text. Have you tried a cat team.gz?  |
||
|
|
Bok7575
Advanced Cruncher Joined: Jul 8, 2008 Post Count: 51 Status: Offline Project Badges:
|
I think that's the browser detecting and automatically decompressing on the fly. Try right click and save as and it will be gzipped.
|
||
|
|
Eric_Kaiser
Veteran Cruncher Germany (Hessen) Joined: May 7, 2013 Post Count: 1047 Status: Offline Project Badges:
|
Bok, you're right.
----------------------------------------At the moment I have only access to a windows computer. I've downloaded that file and it is indeed gzipped. I've unpacked it with 7-zip and the content is not corrupt and readable in notepad++. Edit: Bok, I've connected to one of my linux clients (ubuntu 14.04) and did the wget http://www.worldcommunitygrid.org/boinc/stats/team.gz afterwards gzip -d team.gz cat team Everything is ok. [Edit 1 times, last edit by Eric_Kaiser at Jun 22, 2016 1:14:24 PM] |
||
|
|
Bok7575
Advanced Cruncher Joined: Jul 8, 2008 Post Count: 51 Status: Offline Project Badges:
|
Quick update. I certainly think it's my IP that's being blacklisted by IBM somehow, perhaps unintentionally as I'm not on a static IP given out by my ISP? (I do not have the option of a static IP unfortunately)
For reference, I tried doing the same wget as above but using a public proxy and it works. [root@web3 ~]# wget -e use_proxy=yes -e http_proxy=107.151.152.211 http://www.worldcommunitygrid.org/boinc/stats/team.gz --2016-06-23 11:10:34-- http://www.worldcommunitygrid.org/boinc/stats/team.gz Connecting to 107.151.152.211:80... connected. Proxy request sent, awaiting response... 200 OK Length: unspecified [text/plain] Saving to: “team.gz” [ <=> ] 2,564,840 819K/s in 3.1s 2016-06-23 11:10:38 (819 KB/s) - “team.gz” saved [2564840] [root@web3 ~]# gzip -d team.gz [root@web3 ~]# head team <?xml version="1.0" encoding="iso-8859-1"?> <teams> <team> <id>1</id> <type>2</type> <name>IBM Interactive</name> <userid>1158</userid> <total_credit>4392062.855810</total_credit> <expavg_credit>3770.226806</expavg_credit> <expavg_time>1466683449.314533</expavg_time> Could I possibly get some input from the techs ? |
||
|
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
Happened to be looking at my stats at Free-DC and see to not have had stats for the 20th-22nd, then a big spike on the 23rd, after which normal daily stats resume. Whatever happened, the problem appears [resolved]
[ot] While looking at those stats, notice that the total credit column carries the title 'Results' Project Rank Name Today Last Update Yesterday 2 Days Ago Average Last 7 days Last 28 Days RAC Results<--- JIC you want to amend this :D [/ot] |
||
|
|
Eric_Kaiser
Veteran Cruncher Germany (Hessen) Joined: May 7, 2013 Post Count: 1047 Status: Offline Project Badges:
|
Rob, as far as I've understood, Bok uses as a workaround a proxy. But nobody knows how long this proxy is available. The problem itself is not solved yet.
----------------------------------------[Edit 1 times, last edit by Eric_Kaiser at Jun 27, 2016 9:09:17 PM] |
||
|
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
Eric, you could very well be right. If this continues or recurrs as a problem to de Bok, I'd advise him to use Contact Us, foa knreed. Surely he'll work with him to set up a permanent/satisfactory solution.
|
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Hey, sorry if i'm posting this question in the wrong place but i really need help!
I just started working in the wcg project, my problem is that i can't find how to get my results ( json files) using the wget command I heard that i must configure the wcg cookie's but i really can't find how to do it. I'll be so grateful if someone can help to figure out how i can get my json files using commands |
|||
|
||||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Kindly search forums as .json format and wget were recently discussed by KerSamson /adriverhoef I think.
|
||
|
|
|