Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 37
Posts: 37   Pages: 4   [ Previous Page | 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 5978 times and has 36 replies Next Thread
Mamajuanauk
Master Cruncher
United Kingdom
Joined: Dec 15, 2012
Post Count: 1900
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Reducing the gap from elapsed time to CPU time

Morning again guys!

I'm just running a test to see if using captainjacks suggestion will make a difference and how much.

I've reduced the processor useage to 25% which is running 16 threads, which is the way I'll go with the Captains suggestion, 4 clients, 4 hdd's 16 threads each. (while these threads are running randomly on the 4 cpu's, the hdd is where the test is)

My theroy is that if the hdd is the bottleneck, then this test should produce much reduced gap between elapsed and cpu times.

I've also cleared down all completed tasks and stopped new ones for now, and suspended network activity to allow me to view the tasks and their properties before uploading them..

I'll report back on the results in a bit, both with interim and completed.

Edit: corrected typo's!
----------------------------------------
Mamajuanauk is the Name! Crunching is the Game!



----------------------------------------
[Edit 2 times, last edit by Mamajuanauk at Jun 16, 2014 8:22:18 AM]
[Jun 16, 2014 8:17:48 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mamajuanauk
Master Cruncher
United Kingdom
Joined: Dec 15, 2012
Post Count: 1900
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Reducing the gap from elapsed time to CPU time

Ok so 16 CEP2 wu's have been running for just over an hour...

one task shows the following:
CPU Time: 01:05:36
Elapsed Time: 01:07:50

Another task shows:
CPU Time: 01:07:19
Elapsed Time: 01:10:20

Not looking good thus far...

I'm going to check what disk it has in it...
----------------------------------------
Mamajuanauk is the Name! Crunching is the Game!



[Jun 16, 2014 9:01:49 AM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Reducing the gap from elapsed time to CPU time

It's interesting that you are ready to spend so much time on this ever lasting problem.
Because when you have tried everything possible to optimise your systems (which I think are already high end/top quality ones) maybe somebody will take two old posts of mine seriously. smile

My prognostic is that when you are short of new improvement ideas you will still be missing too many minutes of CPU time per WU.
Then take the time to read these two posts:
Most cores to crunch this project - Oct 25, 2011 8:48:08 AM
Most cores to crunch this project - Oct 26, 2011 11:41:28 PM

Then install BoincTasks (although it is a Windows program it runs very well under Wine in Ubuntu), make sure it updates frequently enough (say at least once per minute) and check yourself what I am saying in my posts.

BoincTasks will divert some more CPU time from the CEP2 tasks, but what you will see will be worth that cost.

I/O contention could explain that CPU time does not increase as expected (although several minutes is a bit too much in my opinion for modern disk units with plenty of cache memory), but it could never explain that CPU time goes backward. laughing
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Jun 16, 2014 9:29:29 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mamajuanauk
Master Cruncher
United Kingdom
Joined: Dec 15, 2012
Post Count: 1900
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Reducing the gap from elapsed time to CPU time

Many thanks JmB, that puts this 'issue' in a different light, I'm going to look at this a different way now.

Most likely I'll run CEP2 under my only 2 windows machines (1 x 8 + 1 x 24 cores) and use the big machines for other things, a shame but I'm not spending time and/or money to fix something that is not, to all intense and purposes 'fixable'

As a final word on this issue. Many thanks for all the advice and suggestions.
----------------------------------------
Mamajuanauk is the Name! Crunching is the Game!



[Jun 16, 2014 9:47:46 AM]   Link   Report threatening or abusive post: please login first  Go to top 
branjo
Master Cruncher
Slovakia
Joined: Jun 29, 2012
Post Count: 1892
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Reducing the gap from elapsed time to CPU time

Mamajuanauk wrote:
Ok so 16 CEP2 wu's have been running for just over an hour...

one task shows the following:
CPU Time: 01:05:36
Elapsed Time: 01:07:50

Another task shows:
CPU Time: 01:07:19
Elapsed Time: 01:10:20

Not looking good thus far...

I'm going to check what disk it has in it...


But it is much better than in OP, isn't it?

Cheers peace
----------------------------------------

Crunching@Home since January 13 2000. Shrubbing@Home since January 5 2006

[Jun 16, 2014 10:33:44 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mamajuanauk
Master Cruncher
United Kingdom
Joined: Dec 15, 2012
Post Count: 1900
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Reducing the gap from elapsed time to CPU time

But it is much better than in OP, isn't it?

Cheers peace

Sorry branjo, but what are you referring to when you say 'OP'

Or am I having a senior moment and it should be something I know? biggrin
----------------------------------------
Mamajuanauk is the Name! Crunching is the Game!



[Jun 16, 2014 12:20:14 PM]   Link   Report threatening or abusive post: please login first  Go to top 
branjo
Master Cruncher
Slovakia
Joined: Jun 29, 2012
Post Count: 1892
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Reducing the gap from elapsed time to CPU time

In your Original Post you mentioned that the difference is "1 - 1.5 hours".

So, if I calculated these "1 - 1.5 hours" against 18 hours (is it still the max for CEP2 task?), it is 92 - 94% utilization.

In the example of your current performance, the utilization is 96%, what I consider "much better" wink

good luck
----------------------------------------

Crunching@Home since January 13 2000. Shrubbing@Home since January 5 2006

[Jun 16, 2014 1:18:26 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Mamajuanauk
Master Cruncher
United Kingdom
Joined: Dec 15, 2012
Post Count: 1900
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Reducing the gap from elapsed time to CPU time

In your Original Post you mentioned that the difference is "1 - 1.5 hours".

So, if I calculated these "1 - 1.5 hours" against 18 hours (is it still the max for CEP2 task?), it is 92 - 94% utilization.

In the example of your current performance, the utilization is 96%, what I consider "much better" wink

good luck

Thanks, I should have known that one!

The latest properties show
CPU Time: 09:00:20
Elapsed Time: 09:27:47

Another task shows:
CPU Time: 07:56:57
Elapsed Time: 08:18:10

Still not looking good, or is it when you work it out?

Still only running 16 wu's
----------------------------------------
Mamajuanauk is the Name! Crunching is the Game!



[Jun 16, 2014 2:52:59 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Reducing the gap from elapsed time to CPU time

Hm, that's pretty interesting. I saw your post/results and decided to check out my CEP2 efficiency as well.

I am using 4-cores of a i7-4771, 4GB RAM dedicated to BOINC, Mac OS X 10.9.2, and a 2TB 5400rpm HDD.

On 4 WUs at once, I'm getting 0.9686 CPU/elapsed time efficiency.
On 8 WUs at once, I was getting a horrible 0.8912 efficiency.

From your most recent 4 data points, it looks like you're getting 0.9583 efficiency. I'm not familiar with multi-CPU architecture, maybe you can try dialing the cores down even more to see if there is any efficiency difference. My theory would be maybe the OS/software or motherboard is not handling the processes efficiently.
[Jun 17, 2014 5:08:49 PM]   Link   Report threatening or abusive post: please login first  Go to top 
branjo
Master Cruncher
Slovakia
Joined: Jun 29, 2012
Post Count: 1892
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Reducing the gap from elapsed time to CPU time

97% efficiency is great taking in consideration that ( confused ) you are using your Mac as a main PC.

CEP2 is (among all other issues) very demanding on RAM - you need 1 Giga per WU. So that is why your utilization is dropping significantly when running 8 concurrent tasks with 4 GB RAM only.

Cheers peace
----------------------------------------

Crunching@Home since January 13 2000. Shrubbing@Home since January 5 2006

[Jun 17, 2014 5:40:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 37   Pages: 4   [ Previous Page | 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread