Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Thread Type: Sticky Thread
Total posts in this thread: 124
Posts: 124   Pages: 13   [ Previous Page | 2 3 4 5 6 7 8 9 10 11 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 447381 times and has 123 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: New Project Setting

Cranking comes at an efficiency price [the more CEP2 running concurrently on one device, the higher the difference becomes between wallclock time and actual CPU cycles used, an issue to many] in addition to a temp issue, not here yet. This efficiency deteriorates exponentially [mostly HD i/o driven], but if that is not an issue for you, go for it. Quite long discussions have gone before on the forum what works... my setup now running 96%+ efficient, but that's only allowing for 2 to run CEP2 out of 4 cores.

--//--
[May 9, 2011 6:27:51 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: New Project Setting

My theory is if I get "problems" that have a 10 day completion window and they're always going back in under 24 hours and usually in under 12 hours, that is good enough for me.

I suppose I could run off the systems' SSD drives, but if RAID 10 isn't good enough...I'd just as soon keep wear on the SSDs down. Although I will be upgrading memory in many of the boxes...that QPI etc. tweaking the X58 chipset practically forces you to do with core i7s has taught me that I should have read some specs a little closer.

Be interesting to see what effect that has on turnaround times.
[May 9, 2011 9:32:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
bicotz
Advanced Cruncher
Canada
Joined: Apr 25, 2010
Post Count: 67
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New Project Setting

Concerning the custom project settings for CEP2, here's my take on it:

Using a quad core for work @ home with lots of Photoshop and Dreamweaver plus some surfing/gaming in the evening, I've set the machine as follows:

Max number of cores in use to 75% (3 cores), run when computer is in use and while processor use is less than 20%.

That way I get a zippy computer because of the unused core and if I play games, the other three cores become available. It pays more to do it this way than shutting down all 4 cores when in use simply because the computer is in use too often.

My 2 cents
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by bicotz at May 10, 2011 6:10:43 AM]
[May 10, 2011 4:25:49 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: New Project Setting

Hi everybody,
thanks for all your feedback and input - that was very helpful.
Best wishes
Your Harvard CEP team
[May 23, 2011 5:22:37 PM]   Link   Report threatening or abusive post: please login first  Go to top 
sk..
Master Cruncher
http://s17.rimg.info/ccb5d62bd3e856cc0d1df9b0ee2f7f6a.gif
Joined: Mar 22, 2007
Post Count: 2324
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New Project Setting

Question - If I configure my home profile online for unlimited CEP2 tasks, stock up on CEP2 tasks, say 3days worth, and then reconfigure my home profile to only crunch 3 CEP2 tasks at a time, will this ensure I am always running 3 CEP2 tasks?

Why? If I configure 3 tasks, my daily turnover is usually well under that (even with the difference between run time and CPU time considered), and if I set it to 4 tasks I find the time delta increases too much, and system performance can become sluggish at times.

My guess is that the number of tasks only controls what is sent, and not what is actually run, (WCG being treated by Boinc as one project) but I might have missed something. I don't want to download 3days of tasks and find I have to micromanage what tasks are running.
[Jun 12, 2011 5:56:15 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: New Project Setting

Dear skgiven,
hmm, that is a complicated one and the behavior is honestly a bit hard to predict - looks like a case for an experimental approach ;). I am unfortunately not too optimistic. What you could do is to exclusively run CEP2 (i.e., deselect all other projects) and then you'd get the 3 CEP2 threads - but that's probably not what you want either. Sorry to not be of more help. Keep us posted on your experience!
Best wishes
Your Harvard CEP team
[Jun 15, 2011 6:27:01 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: New Project Setting

On exclusive WCG this works, very closely to objective:

- Set 10 CEP2
- Set anything else [I do Clean Water]
- Set cache to 0.9 days.

WCG generally pushes enough CEP2, prioritized, that the mix will lead to mostly CEP2 running on 3 threads and when 4 seen it's a brief manipulation of suspend/resume. This is on a mean completion time that my quad is doing for CEP2... 6.51 hours. Still getting a 99% efficiency on that with CEP2 and 99.5+% for Clean Water

Experimenting is the name of the game to find the best balance. With the above mix, the mean "Time Out" is about 28.3 hours.

--//--
[Jun 15, 2011 6:47:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
sk..
Master Cruncher
http://s17.rimg.info/ccb5d62bd3e856cc0d1df9b0ee2f7f6a.gif
Joined: Mar 22, 2007
Post Count: 2324
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New Project Setting

Well, I made some big changes.
First I uninstalled Boinc, then I added another SATA drive, reinstalled Boinc (latest Beta) and set the Boinc Data directory to the second drive. I needed a clean install anyway.
Since yesterday I have just been running 2 CEP2 tasks to see how I got on. I'm now seeing 97.7% efficiency; this is much better than it was previously (~93%), so I might yet find selecting 4 tasks is fine.
I'm going to move my Virtual Memory to the second drive and see if that helps any, but with 8GB RAM in the system, and for the most part using less than 3GB (and never seeing 6GB used) I don't think it will make much difference.
I think the dual channel memory on these SB systems is a bit of bottleneck. Another example of Intel nobbling their own processors.

I thought I could run some non-WCG projects alongside these CEP2 tasks, but when I was trying to run climate models I noticed their efficiency was much worse than these CEP2 tasks, and again down to I/O problems. Both together is a very bad combination; saw CPU usage plummet at times, but cant rule out previous instals of Boinc being at least partially to blame there.
Also looked at Docking, but the balance was not there; it ran more than I wanted it to.

When I downloaded 8 CEP2 tasks and about 25 HCC, Boinc did not start to crunch 4 CEP2 tasks straight away. Didn't have much chance either as the HCC deadlines were 23rd and the CEP2 were 26th. I have since found FAAH, C4CW, HPF2 and HCMD2 all have about the same deadline as CEP2, so perhaps when the HCC tasks complete these will roughly give me the 3/4 CEP2 tasks I am looking for.

- When the HCC tasks finished, Boinc decided to run 6 CEP2 tasks together. Not what I had wanted, but it did let me see the efficiency improvements; now risen to about 98% when 6 CEP2 tasks are running (1 CPU thread free, 1 used by a GPU project). So obviously the drive changes did make a difference. I think I will try just running CEP2 tasks for a while on this SB system and see how it gets on in the long run.
----------------------------------------
[Edit 2 times, last edit by skgiven at Jun 16, 2011 8:10:04 PM]
[Jun 16, 2011 5:20:57 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: New Project Setting

Just as an "FYI" for new people contemplating dedicating crunching boxes:

What I did (for summertime use, where I am more concerned about processor Tj temps than anything else) to ensure I always left one "core" (that is, on hyperthreading CPUs one physical or virtual "core") free was to:

BOINC manager/Advanced Menu/Preferences/Processor Usage tab:

Since it is CEP2, "Use at most 100% of processor time"

Then to control # of work units running simultaneously:

"On multiprocessor systems, use at most (Ct - 1) / Ct) % of processors"

where Ct = total (physical + virtual) cores

So on a hyperthreading i7 950 with 4 physical cores + 4 virtual cores, I set % processor usage at ((8 - 1) / 8) x 100 = 87.5%.

On a hyperthreading i7 980x with 6 physical cores + 6 virtual cores, I set % processor usage at ((12 - 1) / 12) x 100 = 91.67%.

That has resulted in my PCs consistently running (Ct - 1) work units; e.g. 7 work units running simultaneously on an i7 950 and 11 work units running simultaneously on an i7 980x.

Bearing in mind that I have an "always on" internet connection throttled at 3 Mbps upload/15 Mbps download, on the Preferences/Network Usage tab, I set the "Additional Work Buffer" to 0.6 days for all dedicated crunching machines. This has consistently resulted in roughly (Ct + 1) work units "ready to run" in queue locally.

Total CPU loading does indeed track the percentage I specify (wtg, WCG/BOINC!!) - and, importantly (to me), in an ambient temperature of 23.3 degrees Celsius/74 degrees Fahrenheit, my Tj temps average 60 degrees Celsius/140 degrees Fahrenheit, well within the Intel specs.

Now during the winter I tend to run all cores flat out because a) the ambient temperature can be reduced without costing me any money and b) the idea of heating my office and beyond with computers that are searching for alternative energy sources tickles me.

I hope that information may prove to be of use to someone new....heck, to tens of thousand sof new crunchers each and every day (one can always hope).
[Jul 16, 2011 6:08:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: New Project Setting

Hi and thanks for sharing.

Small note. You don't have to enter exact percent fractions. e.g. 92% will round the allowed cores/threads to the rounded down to the nearest whole core, so with a quad setting 99 or 76% or 75% percent will all restrict cores to 3.

Changes of allowed cores/threads is immediate upon a client-server connection when updating the website profiles or after doing an OK in Local preferences. On 6.10 and earlier clients there will be a benchmark. With 6.12 that's no longer the case (just tested).

Happy Crunching.

--//--

edit: insert °rounded down° for those who like it exact.
----------------------------------------
[Edit 1 times, last edit by Former Member at Oct 16, 2011 6:18:04 PM]
[Jul 16, 2011 6:48:00 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 124   Pages: 13   [ Previous Page | 2 3 4 5 6 7 8 9 10 11 | Next Page ]
[ Jump to Last Post ]
Post new Thread