Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 115
Posts: 115   Pages: 12   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 482244 times and has 114 replies Next Thread
3gBxgbp9SYFbvHvp9Z7K4dPwCYNJ
Cruncher
Joined: Dec 9, 2017
Post Count: 3
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unable to Use API

Thank you Juan for the clarification.

Protecting my personal data is important to me. Time will tell us if GDPR (or its correct interpretation) will make our personal data more safe. At least a major step forward.

IBM is around for more than 100 years and compliance is a major value for IBM. So fully understood that IBM does not want to pay a GDPR fine for WCG.

The downside is that now certain functionalities such as boincstats, gridcoin and byteball which motivated me and may be many others to allocate more CPUs than just our laptops or desktops are no longer available.

Looks like this will not be solved soon and therefore like KliK wrote users may consider to switch from WCG to other boinc projects (like I will do now with 36 out of 38 cores - currently).

My understanding is that boincstats, gridcoin, byteball are services and not processors as defined in GDPR. Therefore I would have expected check boxes in the settings where I as a user can decide to share the data with such services - even in the case where deletion from a blockchain is by definition not possible.

Are we just learning that the GDPR does not work together with any kind of blockchain - some more work for the EU.
[May 30, 2018 6:59:47 PM]   Link   Report threatening or abusive post: please login first  Go to top 
KerSamson
Master Cruncher
Switzerland
Joined: Jan 29, 2007
Post Count: 1684
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unable to Use API

Hi jhindo,
I appreciate that you try to provide some answers. However, I cannot be satisfied with the statement "personal information is defined fairly broadly".
Last Sunday (2018-05-27), I took the time to analyse the GDPR impact on WCG contribution exports. I don't claim that I made a perfect analysis, nevertheless I am still considering that the current situation is the result of a "quick & dirty" overreaction.
It is possible to implement a "smooth way" mainly relying on user "opt-in" settings without breaking everything, in particular regarding the connection to external web sites.
I would really appreciate that WCG (i.e. IBM) would be able to recognize the mistake and to change the compliance implementation approach, instead to persevere and to lose valuable contributors.
I am really concerned that the current situation would significantly damaged WCG computational power because of loosing some of the most dedicated contributors.
Yves
----------------------------------------
----------------------------------------
[Edit 1 times, last edit by KerSamson at Jun 1, 2018 9:28:36 PM]
[May 30, 2018 7:35:44 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Unable to Use API

Help!! I have been getting message "World Community Grid Not Running" for months. How Do I start shareing my computer again?
[May 30, 2018 7:52:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
DPC_Oi!
Cruncher
Joined: Dec 28, 2005
Post Count: 6
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unable to Use API

I looked up a copy of the GDPR and found this definition of 'personal data' on page33:
(1) ‘personal data’ means any information relating to an identified or identifiable natural person (‘data subject’); an identifiable natural person is one who can be identified, directly or indirectly, in particular by reference to an identifier such as a name, an identification number, location data, an online identifier or to one or more factors specific to the physical, physiological, genetic, mental, economic, cultural or social identity of that natural person


Just below that is the definition of 'pseudonymisation':
(4) ‘pseudonymisation’ means the processing of personal data in such a manner that the personal data can no longer be attributed to a specific data subject without the use of additional information, provided that such additional information is kept separately and is subject to technical and organisational measures to ensure that the personal data are not attributed to an identified or identifiable natural person


Then I looked up any relevant mentioning of 'pseudonymisation' and found this on page 5:
(26) The principles of data protection should apply to any information concerning an identified or identifiable natural person. Personal data which have undergone pseudonymisation, which could be attributed to a natural person by the use of additional information should be considered to be information on an identifiable natural person. To determine whether a natural person is identifiable, account should be taken of all the means reasonably likely to be used, such as singling out, either by the controller or by another person to identify the natural person directly or indirectly. To ascertain whether means are reasonably likely to be used to identify the natural person, account should be taken of all objective factors, such as the costs of and the amount of time required for identification, taking into consideration the available technology at the time of the processing and technological developments. The principles of data protection should therefore not apply to anonymous information, namely information which does not relate to an identified or identifiable natural person or to personal data rendered anonymous in such a manner that the data subject is not or no longer identifiable. This Regulation does not therefore concern the processing of such anonymous information, including for statistical or research purposes.

(28) The application of pseudonymisation to personal data can reduce the risks to the data subjects concerned and help controllers and processors to meet their data-protection obligations. [..]

And this on page 29:
(156) The processing of personal data for archiving purposes in the public interest, scientific or historical research purposes or statistical purposes should be subject to appropriate safeguards for the rights and freedoms of the data subject pursuant to this Regulation. Those safeguards should ensure that technical and organisational measures are in place in order to ensure, in particular, the principle of data minimisation. The further processing of personal data for archiving purposes in the public interest, scientific or historical research purposes or statistical purposes is to be carried out when the controller has assessed the feasibility to fulfil those purposes by processing data which do not permit or no longer permit the identification of data subjects, provided that appropriate safeguards exist (such as, for instance, pseudonymisation of the data). [..]


I am no legal expert, but it sounds to me that pseudonymisation should give room to work with.
[May 30, 2018 11:04:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Unable to Use API

https://bitcointalk.org/index.php?topic=2388064.msg38623787#msg38623787

Another team is pulling out crunchers until this can be resolved.

Since I personally view it as unfair to continue to assess the WCG crunchers at the current static level (since we have new users being onboarded and we have
RAC changes), but otoh, I also view it as unfair to 'pull the plug' on every researcher who has built up RAC on WCG for biblepay, I have decided to implement a
temporary World Community Grid RAC decay process for 14 days. The idea behind this is to phase out world community grid Biblepay wide until the DPA is signed and tested.

To implement this I plan on reducing the WCG Credit factor by .10 per day until it reaches 0. On May 26th, the factor will be 1.4, May 30th: 1.0, June 9th: 0 (project removed).

[May 31, 2018 2:30:06 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TonyEllis
Senior Cruncher
Australia
Joined: Jul 9, 2008
Post Count: 286
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unable to Use API

Most of the time the newly modified script used to export my statistics works well...
However, every so often end up with an error in the logs. Here are a couple of samples...

Thu May 31 10:19:13 AEST 2018
Errors detected:
Access is denied. To request access, refer to https://www.worldcommunitygrid.org/help/viewTopic.do?shortName=api

Thu May 31 20:54:12 AEST 2018
Errors detected:
Access is denied. To request access, refer to https://www.worldcommunitygrid.org/help/viewTopic.do?shortName=api

AEST = Australian Eastern Standard Time
This would appear to not be an appropriate error message for whatever is failing at WCG...
----------------------------------------
[Jun 1, 2018 1:06:19 AM]   Link   Report threatening or abusive post: please login first  Go to top 
nuclearpowerplantmochovce
Cruncher
Joined: Mar 30, 2018
Post Count: 19
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unable to Use API

my servers is away from WCG = very sad :( this is end for WCG for me
[Jun 1, 2018 2:56:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unable to Use API

That's a pity, Tony, when the script at times doesn't return what you expected. This way of retrieving results from WCG's website is all very new and until now, most of the time, my script has been relying on successful transfers and to forget about unsuccessful ones (since these problems almost always seem to be of a temporary nature). Also, I haven't noticed my script failing in this way yet in the past week and I'm running it each half hour to watch the queue (in a terminal) and once per hour to record all my results (via crontab).
Just right now I tried "for i in `seq 1 50`;do wcgresults -dqq;done" (requesting my current queue 50 times in a tight loop) and all went well.
The thing is that if something goes wrong somewhere, WCG will probably just return this error:
{
"errors": [
{
"code": 401,
"message": "Access is denied. To request access, refer to https://www.worldcommunitygrid.org/help/viewTopic.do?shortName=api"
}
]
}
I have seen this error before in the past week without the 'code 401', they added that between 01:00 UTC and 02:00 UTC on 25th May, so I know WCG is working on it. When such an error occurs, it is possible to try and investigate the error if and only if any output or files during the running of the script have been saved. The script tries to be silent though. I could supply a version of 'wcgresults' that saves some files during each run and then, when such an error occurs, we could investigate further with the files that were saved during the errored run to see if we can do anything about it. Or else we could add more code to the script to find something useful of what went wrong. Or make the script more silent, so that you don't get to see the 'access denied' error in case of such events. Maybe new opportunities could arise when WCG's next planned maintenance will be carried out.

Also, 10:00 AEST is 00:00 UTC. So it could be that the statistics at the WCG site are being updated at 10:19:13 AEST so that your results have been unavailable for a short while.
[Jun 1, 2018 4:22:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unable to Use API

@adriverhoef

My guess is that it is failing on the login step and thus it doesn't have the right cookies when it gets to the api call.

If you modify the login step so that it checks if you are redirected to the login error page doing something similar to this:

let error=`wget -O /dev/null https://www.worldcommunitygrid.org/j_security_check 2>&1 | grep Location | grep /viewLoginError.do | wc -l`


Then you could check for $error -eq 1 meaning that login failed for some reason.

That could help me figure out what is going on - or - your could have your script retry login (or both).
[Jun 1, 2018 10:01:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2346
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Unable to Use API

@knreed

let error=`wget -O /dev/null https://www.worldcommunitygrid.org/j_security_check 2>&1 | grep Location | grep /viewLoginError.do | wc -l`


Then you could check for $error -eq 1 meaning that login failed for some reason.

That could help me figure out what is going on - or - your could have your script retry login (or both).
Thank you for thinking with me. I see what you mean. Yes, the login probably failed.

Another idea springs to mind: we could look at the cookie file. A successful login would look something like this:
	.worldcommunitygrid.org	TRUE	/	TRUE	1527946318	Setup	…
.worldcommunitygrid.org TRUE / TRUE 0 WCG-LtpaToken2 …
.worldcommunitygrid.org TRUE / TRUE 1527896318 WCG-SESSION …
A login failure on the other hand is looking like this:
	.worldcommunitygrid.org	TRUE	/	TRUE	1527896270	WCG-SESSION	…
Do you think the script could learn something useful from the cookie file? For the moment I've implemented something in a test environment where I need "WCG-LtpaToken2" in the cookie file and if that string is absent, then login failed. I know something like "LtpaToken2" could change without any notice from WCG's administration, but I guess it will do for the time being. I've also added some code that Tony could use if there's a desire to further investigate (i.e. Tony would now only need to put a "#" in front of the line "DEVNULL=/dev/null" that I've put into the test-script).

Another way to look at it: the 'wcgresults' script never reported a login failure before 25-05-2018, so I could be trying to keep it that way. biggrin
----------------------------------------
[Edit 1 times, last edit by adriverhoef at Jun 2, 2018 1:06:19 AM]
[Jun 2, 2018 1:05:03 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 115   Pages: 12   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread