Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 3
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2080 times and has 2 replies Next Thread
Hypernova
Master Cruncher
Audaces Fortuna Juvat ! Vaud - Switzerland
Joined: Dec 16, 2008
Post Count: 1908
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
biggrin How to credibly benchmark your machine in WCG

Sek and Jean Pierre, I agree that I polluted a little your threads.
Sorry for that praying . So here is a separate one. smile

For those who just read for the first time please check the threads:
Technology News and Building the 400 TFLOP Machine.
I understand that there was something already defined from the beginning at WCG, on ratios between Points, Credits and GFLOP, TFLOP etc. But this is not carved in stone. This is not the absolute truth. Things may change, may evolve like the computer industry has evolved over the last 20 years etc.
The ratio I mentioned of 1 TFLOP = 8 WCG points was rounded (8.1 in fact)and calculated on one day the 1st June. On the 2nd June yesterday it was 8.04.

Saying that we prefer to stay with 1TFLOP = 700'000 WCG points is an arbitrary choice as WCG Points could be anything. I do not discuss the 1 to 7 ratio BOINC to WCG. But then if we keep the same logic do not call those TFLOP, but WCGFLOP or anything else, and then I will have nothing to say. But I will also have no idea what my CPU really does and how he performs.

If we want members to rate their machine more or less to some real crunching performance of their CPU in terms of operations done, then we should have a ratio calculated back from real crunching data, and not from theoretical formulas. What I tried to do, (and I am far from being perfect) is to relate some real CPU benchmark, embedded in Boinc and the overall global result as measured by WCG.
Each CPU has different crunching performances and each project is also a different mix in type of operations FLOP (floating point) or IOP (integer) and IP (instructions).
If the aim is to have a common base of comparison then the global ratio is the best one because it is the average result over all projects and all type of machines.
By making the test on a specific machine like the 980X and if we suppose the projects crunch with half FLOP and half IOP then we get to a ratio of:
1 TFLOP = 9.3 WCG points.
This is not so far to the real WCG average of about 8. This also shows that the connection between the physical benchmark carried out and WCG global data there is consistency.
If we look at theoretical and commercially published maximums by Intel we are well under that max performance for sure but again it is inside the envelope of what can be expected, as projects are not optimized for one specific CPU but are written to run across a very large quantity of machines and operating systems.

As a conclusion everybody is free to do what he wants. As an example my solar systems emits HEGP (High Energy Graviton Particles) and not WCG points laughing

But if we want to talk performance in terms of real CPU work the nearest way to approach the truth is : 1 TFLOP = 8 WCG points.
Period. cool
----------------------------------------

----------------------------------------
[Edit 2 times, last edit by Hypernova at Jun 3, 2010 9:32:01 AM]
[Jun 3, 2010 9:29:22 AM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: How to credibly benchmark your machine in WCG

Hypernova,
The confusion comes from the fact that you are misunderstanding this ratio.
It has been evaluated by the BOINC community to satisfy people who absolutely wanted to compare the power of distributing computing to supercomputers.

After (I presume) reasonable studies on various grids "they" came to the conclusion that 1 Tflop is more or less equivalent to 100,000 BOINC credits, and thus 1 Tflop is equivalent to 700,000 WCG points since the ratio between WCG points and BOINC credits has been fixed to 7 precisely.

Obviously this is a gross equivalence which can only be used for gross approximations: on one hand various grids do not all reward work done exactly the same, and on the other hand since this encompasses so many very different hardware and software configurations it is meaningless to assume that this ratio can be used seriously to evaluate any single individual machine.

Conclusion: the fact that it is not good for your machines does not mean that it is forcibly wrong at global level nor that you can make a case to have Sekerob or anybody else to use another value for global comparisons. Simply use yours for your machines, and that's it.

Cheers. Jean.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Jun 3, 2010 11:30:33 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Hypernova
Master Cruncher
Audaces Fortuna Juvat ! Vaud - Switzerland
Joined: Dec 16, 2008
Post Count: 1908
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: How to credibly benchmark your machine in WCG

Jean,

I think you missed the point when you consider that it is my machine specific. The ratio of 1 TFLOP = 9.3 WCG Points is specific to my machine, that is correct.
The ratio of 1 TFLOP = 8 WCG Points is NOT specific to my machine and is NOT calculated with my machine.

It is true that I did not mention how I calculated. Here is how:

1) The Total WCG points produced by the grid yesterday is to be found under Statistics/Global Statistics/Global Statistics History and is for yesterday 2nd June:
275'181'551 WCG Points

2) The WCG TERAFLOPS value for 2nd of June is taken from the daily updated tables made by Sekerob and called Teraflops by Day & Project (link http://i137.photobucket.com/albums/q210/Sekerob/WCGProjectTFL2.png)
The value is 395.97 TFLOPS or TFLOP/Second which correspond to a daily total volume of 395.97 X 86400 = 34'211'808 TFLOP.
86400 is the number of seconds in a day.

On that base the ratio is:
275'181'551 / 34'211'808 = 8.043 rounded to 8

Hence the conclusion 1 TFLOP = 8 WCG Points. smile
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by Hypernova at Jun 3, 2010 12:13:20 PM]
[Jun 3, 2010 12:12:46 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread