| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
| World Community Grid Forums
|
| No member browsing this thread |
|
Thread Status: Locked Total posts in this thread: 277
|
|
| Author |
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
bright light at tunnels end Sigh. . . .We are working to diminish / eliminate the disparity between Windows and Linux, but I have no doubt at all that there will be many quirks remaining on one system or another. Computer systems and their operating environments are too diverse to really allow cross-comparisons across the entire field. Some sorts of systems are going to face unfair advantages / disadvantages. I'll settle for a good-faith effort when some situation really bugs a lot of people. Lawrence |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Any efforts to address benchmarking disparities are greatly appreciated.
As to the "cheater" penalty, from the wu's I have looked at, it seems to be working as intended. Still don't think it was necessary and believe it sent the wrong message, but if you felt you had to act, fine. I remain bewildered why you messed with the rest of quorum system. I have looked at a lot of wu's and am glad that the changes have had as little effect as they have. I commend the programmer/analysts for doing a good job given their directive. But what was the point? Some quorums score a little less, some the same, some more. Unfortunately, it seems more less, so there appears to be a small drop-off in points. Which I guess is ok from a relative standpoint because everyone in the quorum drops off together. The problem, though, is that now, instead of continuing to build momentum adding machines to the cause, people are wondering why their points are dropping. Now, before I get barraged by the "points don't matter" crowd, I'd like to say that they do. Not for their own sake, and not only because they serve as competitive motivation, but becuase points are the closest thing we have to measure science contributed. Run time doesn't acknowledge science produced. Results returned depends on the size of the wu's. Points are the only measure we have to gauge how much science we're contributing on a daily basis. So when the point system is changed in response to wild accusations from an irrational few, and dedicated, serious crunchers feel negatively impacted by the changes, it can't help but disturb momentum and erode confidence concerning the priorities of the project leaders. |
||
|
|
Movieman
Veteran Cruncher Joined: Sep 9, 2006 Post Count: 1042 Status: Offline |
bright light at tunnels end Sigh. . . .We are working to diminish / eliminate the disparity between Windows and Linux, but I have no doubt at all that there will be many quirks remaining on one system or another. Computer systems and their operating environments are too diverse to really allow cross-comparisons across the entire field. Some sorts of systems are going to face unfair advantages / disadvantages. I'll settle for a good-faith effort when some situation really bugs a lot of people. Lawrence Lawrence: I see what you guys are doing as a good faith effort. No, it's not perfect but it is a attempt to try and fix some of the issues and for that you have my thanks! I also laughed when I saw in one of my own WU someone in the quorum had claimed app 4 times what I and the 3rd party had claimed and he got 1/2 of what we did. That sends a message loud and clear. Use the stock client or WCG will take a bite out of your backside. Nice touch with that part! ![]() ![]() |
||
|
|
knreed
Former World Community Grid Tech Joined: Nov 8, 2004 Post Count: 4504 Status: Offline Project Badges:
|
Rob725,
There are a few points that I would like to share with you: 1) 5% of results being returned were claiming 2-3 times higher. After looking at the results, these computers were not doing work any faster then other computers - they were simply claiming more points. The existing variation in the 'stock' benchmarks is no where near this broad thus the points they are claiming does not represent more work being accomplished. It was important to address this for exactly the reasons you mentioned i.e. people do enjoy the competition but it is only a fun competition if it is as fair as possible. Also - if people use the points to measure how much science they are doing and comparing their contributions to others, then the only way to make that a valid competition is to do the best to keep the field level. 2) These users who claimed high benefited in two ways. The most dramatic is when two people claiming high return results for the same workunit. This allowed them to get pretty close to what they claimed. The second way that they benefited was that by making sure they were also the high claim, then the credits granted would sometimes be higher. Let me use an example to explain. Under the old system lets say there were three computers who returned 50, 45 and 43. The credit granted would be 45. However, lets say that the user who had the 45 had instead used a different client and claimed 102. Then the credit granted would have been 50 - a boost of 11.1% . Under the new system the granted credit would be the average of 50+43 or 46.5. This further eliminates the advantage of claiming high as well as it takes more values into consideration when determining granted credit. |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Thanks knreed.
I am still puzzled as to why my slowest and oldest machines claim the most points. Sufficient one would think to be outliers at times. On a similar note. Is there an explanation for the cronically low claiming machines in the quorum? These will doubtless have a dramatic impact on overall points now. Cheers. ozylynx ![]() |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
That's a point I'm trying to research right now. It's very complicated...
|
||
|
|
keithhenry
Ace Cruncher Senile old farts of the world ....uh.....uh..... nevermind Joined: Nov 18, 2004 Post Count: 18667 Status: Offline Project Badges:
|
In my case, I am getting the impression that crunching HDC WU's yields somewhat fewer points that FAAH WU's on the same box. I need to pull some data and crunch some numbers to see if my impression is correct. I expect that I'd want to look at it in terms of claimed point per unit of runtime so that I'm making an apples to apples comparasion. Still, I have to wonder if the science app. for each could be different enough such that noticable/significant differences are possible. Anyone have any suggestions or ideas as well? I could be barking up an empty tree but it may be time to find out.
---------------------------------------- |
||
|
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
KeithHenry,
----------------------------------------u need to qualify the "somewhat less points for HDC". I run the HDC 1/5 to 1/2 of the time than FAAH. If you're talking per hour.... i have the exact opposite, but it's purely because the partners in the quorum are generally higher claimers.... the averaging is nicely smoothing it out now. cheers
WCG
Please help to make the Forums an enjoyable experience for All! |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
The project Devs are WELL out of order !!
----------------------------------------Lot`s of people have /do use crunch3rs optimisation, if you had wanted to stop that which is fine it should have been approached differently not by suddenly penalising without knowledge of new laws. 1) The project should have openly declared any optimisation except the default as illegal as far as it was concerned. 2) An amnesty should have been declared, stating rules were about to change. I say change because no hard rule was EVER declared by the project about use of such opti`s. I have been away/still am sorting out problems in my personal life if I hadn`t by chance looked at my scoring and noticed the plummet it would remain downward bound. I am not happy at what appears a lack of communication especially in these days of electronic communication which is fairly instant and comparitively easy to bulk send. To be honest if it wasn`t for my teamies I`d jack DC on right now, I got problems enough without getting half of what others get when it isn`t necessary. If punishment is what I get for my efforts you`ve lost my respect. This is total crap ! Why is it you science guys haven`t the balls to say FIRST. Don`t pi$$ down my neck and tell me it`s raining. And for those spineless wonders who will say I was cheating I have been using crunch3rs for eons......It didn`t make any difference here because of the quorum until NOW ! Punishment without fair warning or written guidance is not justice. Yes I`m changing back to default and dumping what is on my machines but a warning would have good ! [Edit 3 times, last edit by Former Member at Nov 10, 2006 9:51:06 PM] |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
WCG has always had a policy of only supporting the official client. This has been clarified on numerous occasions.
In particular, the specific example of using optimised clients for the sole purpose of inflating scores has been thoroughly discredited. If you were in any doubt that this is regarded as cheating, then you must have been deliberately ignoring the discussion on the subject. If that wasn't enough, the XS team got an official ruling on the question, and changed their team recommendation as a result. As you can see, the penalty system is wonderfully effective at bringing the problem to your attention, and forcing you to take action. Nobody is blaming you for using the optimised files (unless you were using them in an attempt to cheat) but I hope you can understand that people doing this are causing problems with the credit system. WCG have found a solution. |
||
|
|
|