Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 21
Posts: 21   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 6274 times and has 20 replies Next Thread
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Badges missing?

This is a long shot, but could the difference in the figures be attributed to the difference in the way WCG counts time vs, the way WUProp counts time ?
Cheers
Different in which way? CPU Time vs Elapsed Time? That would render the WUProp tool unusable to begin with in that regards, and while this can be highly host dependent, the difference seems to be too small for that. I get an "efficiency" of about 85% for MCM1 and 88% for OPN1 (82% for OPNG). That's across the board, of all hosts, from 12th Gen i7 down to a lowly Dual Core P4 or a Raspberry Pi 4+...

Ralf
[Jan 3, 2023 2:15:37 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7846
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Badges missing?

Different in which way? CPU Time vs Elapsed Time?

Yes, that is what I was thinking. But if the difference is too small to matter, then this would be a dead end.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jan 3, 2023 2:35:46 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Badges missing?

Different in which way? CPU Time vs Elapsed Time?

Yes, that is what I was thinking. But if the difference is too small to matter, then this would be a dead end.
Cheers
Well, without further information/confirmation from those folks that complain, this is hard to tell. It is definitely project dependent, depending on the overall sample size and of course on the hosts.
I have only my environment as a base, and as far as current projects goes it is for MCM1 49,521WUs/84.72% efficiency (CPU time/Elapsed time), OPNG 22,110 WUs/87.84% (OPNG 9851 WUs/81.81%) and ARP1 is actually the most efficient one with 92.05% but only with 71 validated WUs. This is across all hosts.
On the hosts, I noticed some variations between CPUTime and elapsed time. I didn't have much time to work on my own stats program due to Real Life issues, so I can't at this point not be more specific, but I noticed that some hosts, like a 12th Gen i7 with 10C/20T seems to have a much lower efficiency than my 8th Gen i7 laptop with 6C/12T, for MCM1, it's probably 70% vs. 85% between those two. And both computers are actively used during work hours.
But in general, I am pretty sure that the efficiency, as in CPU Time vs Elapsed Time, anything over 90% would likely be an exception.And for that even, PMH_UKs numbers don't seem to match....

Ralf
[Jan 3, 2023 3:14:04 AM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 1317
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Badges missing?

Regarding "efficiency" and Ralf's remark from the previous post, quoted below...
But in general, I am pretty sure that the efficiency, as in CPU Time vs Elapsed Time, anything over 90% would likely be an exception.

I don't have any systems that run both BOINC and "real-world" production work (and they're all running Linux), so my efficiency experience is likely to be different to Ralf's... However, I do want to note that I start wondering what's going on if task efficiency drops below 97 or 98% as it usually indicates a system problem, and efficiency well over 90% is very common if my wingmen are anything to go by :-)

To provide some data points I just did some ad hoc queries on my Wingmen database (SQLite3) when I saw Ralf's post. With no access to medians, standard deviations and such like to do a proper analysis in a hurry. I'll just summarize :-) Note that I don't let BOINC have more than 75% of "CPUs" - experiments using more resulted in various throughput and efficiency issues on my systems.

Of the WCG [non-GPU] projects I find ARP1 the least "efficient" (no surprise with the amount of output it does, which is not going to SSDs on any of my main systems at present...) and I get over 98% on both the systems well enough resourced to run ARP1. (And wingmen's total CPU divided by total elapsed yields over 95% on ARP1!)

My laptop (which I use quite a lot for browsing and such like, only manages 95..96% for MCM1 and OPN1, but my other systems manage over 99% efficiency for MCM1 and OPN1. The wingman "grand average" is about 95% for MCM1 and about 93% for OPN1. (Interestingly, the laptop manages 99% at TN-Grid!)

My Raspberry Pi (which uses a USB3 SSD) gets over 99% efficiency on OPN1 (the only WCG project it can run) and almost 100% efficiency at TN-Grid (less I/O!) -- I think that highlights where the efficiency drop is :-)

Now, of course, it can be pointed out that my sample of about 16,500 tasks (and about 13,200 wingmen's tasks - lower because of adaptive replication on OPN1) gathered since WCG resumption is an insignificant sample, but if others can speculate so can I :-) And I find I can't agree with that sub-90% assessment if we're talking about BOINC running on machines that are not "real work" platforms as well...

Cheers - Al.

P.S. The OP has only clocked up just over 15 years total according to the member statistics comparison, and as there are 10 years or more of OPN1 in there (suggesting MCM1 is possibly only a recent fall-back given it's only at 1 year?) I think the earlier comments about said user's distance from the next badges was on target :-)
[Jan 3, 2023 11:28:54 AM]   Link   Report threatening or abusive post: please login first  Go to top 
PMH_UK
Veteran Cruncher
UK
Joined: Apr 26, 2007
Post Count: 786
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Badges missing?

WUProp https://wuprop.boinc-af.org/
"WUProp@home is a non-intensive project that uses Internet-connected computers to collect workunits properties of BOINC projects such as computation time, memory requirements, checkpointing interval or report limit. You can participate by downloading and running a free program on your computer. "

Paul.
----------------------------------------
Paul.
[Jan 3, 2023 4:44:12 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Badges missing?

Thanks Alan for providing some additional numbers here. And I must admit, I am a bit surprised.

To be clear about my post, as "efficiency" I am counting the "CPU Time" used for a specific WU against the "Elapsed Time" of that WU. This data is what I got by downloading daily (with a 2 day exception due to work out of town) the CSV file from the Results page of the WCG web site from August 23rd 2022 until today (well, yesterday). and process that data with my own stats program, because at that time (end of August) the WCG internal stats had been running for the 2 months since WU started being send out "for testing". One of the things I was always curious about the last few years was how much time the BOINC client is actually using on my hosts.

As I mentioned before, ALL my hosts are actually computers that are being used, in one form or another, some more, some less, during regular work hours and some beyond. Not a single one of my hosts is operating purely to crunch for WCG (or other BOINC projects). This is currently roughly a total of two dozen machines (haven't bothered to do an exact count), with about half of those being machines I have either physical access or at least remote access (like some servers). The rest are machines that I got permission to use their "spare CPU cycles but which I do not have access to for months because they are at friends or customers without remote access. A few of those are machines I haven't touched for at least a couple of years since I have set them up.
This is also the reason why I do not modify the default BOINC client settings after install. Not only do I not have the time and desire to babysit each and every one of my hosts, I just don't have access to them. For me, once BOINC is installed and projects (99% WCG, a couple have at least one other, non-WCG, project added) activated, it is pretty much hands-off, fire and forget.That's why I am so frustrated when the system doesn't work and we have to deal with download errors or other issues, as those are events that at some point "stuff up" the hosts and result in messages, more or less annoying for specially those for me not accessible machines and their users.

One additional observation that I have made in recent days is that the number of WUs in PV jail (Pending Validation and Pending Verification) in my local database derived from the Results page download is deviating from the number of such results shown with the filters set accordingly on the Results page, by at least a couple hundred WUS (more precisely, Results). This is currently about a 100% difference (747 in my database vs 382 shown on the web site). Those PVa/PVe WUs don't count in my efficiency calculation, I do count only valid resuls. But that should not account for the difference between my general efficiency numbers and those from Alan.
Interesting for me is also while ARP1 shows for me the highest percentage of all active projects, while for Alan, this is apparently the project with the lowest efficiency. But with a very small sample size of only 71 valid results in 4 months counted, I am not sure how valid that statistic would be on my side.

Ralf
[Jan 3, 2023 4:48:44 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 2173
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Badges missing?

WUProp https://wuprop.boinc-af.org/
"WUProp@home is a non-intensive project that uses Internet-connected computers to collect workunits properties of BOINC projects such as computation time, memory requirements, checkpointing interval or report limit. You can participate by downloading and running a free program on your computer. "

Paul.
Thanks Paul, I was not aware of that. And I am using BOINC ever since SETI@Home switched from their own DC system to BOINC many, many moons ago. Fascinating what people use their time on, I will see when I get some time to look more closely what they are doing and exactly how they are doing it...

Ralf
----------------------------------------
[Edit 1 times, last edit by TPCBF at Jan 18, 2023 6:28:41 PM]
[Jan 3, 2023 4:53:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7846
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Badges missing?

I am showing the following efficiency ratings for my current 4 machines.
General use Windows 7 I7-3770 96.95%
Dedicated Linux I7-2600 99.08%
Dedicated Linux Xeon E5-2665 99.67%
Dedicated Linux Xeon E5645 99.92%

This is just for the last 683 results which are all MCM.
For a while I had kept pretty detailed statistics with over 100,000 results and these numbers are consistent across projects.

Noted these have nothing to do with efficiency per kilowatt hour. This is cpu time divided by elapsed time.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
----------------------------------------
[Edit 1 times, last edit by Sgt.Joe at Jan 3, 2023 6:21:22 PM]
[Jan 3, 2023 6:20:00 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Ciannicay
Cruncher
Joined: Jun 5, 2019
Post Count: 5
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Badges missing?

Hi Guys,
as for my OP: scratch that,
I just gotten an other badge so the system is still working for me and the time between badges simply was far longer than I expected.

Thanks for all your input!

Kind Regards
Ciannicay
[Jan 8, 2023 2:10:27 AM]   Link   Report threatening or abusive post: please login first  Go to top 
thunder7
Senior Cruncher
Netherlands
Joined: Mar 6, 2013
Post Count: 238
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Badges missing?

Now that everybody is running MCM, and lots of big resources are chomping those tasks, why isn't there a 500 year badge? I mean, even IBM doesn't have one, so I would conclude it doesn't exist.

Disclaimer: I hope to get there in about 100 days, and I want one!
[Jan 20, 2023 5:16:24 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 21   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread