Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Thread Type: Sticky Thread
Total posts in this thread: 1840
Posts: 1840   Pages: 184   [ Previous Page | 17 18 19 20 21 22 23 24 25 26 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1027610 times and has 1839 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Research Log: Updates from the Harvard Team

You need to toy a bit and sort the processes by CPU% and CPU Avg and only specify rules for those that use the CPU at a high percent and ignore those that don't. Just fired up my copy 3.99.99 alpha. Not updated for a long time as it does things as I like it... no need to fix things not broken. DON'T use the number of process limiter. That could kill a running task and cause it to be reported as a user abort.

CEP2 number of cached tasks is specified in the website device profile, custom section. It's the only WCG science that allows to specify how many a client can have ''in progress'' and combo'd with PL an ideal companion to manage the individual core loads.

--//--
[Feb 28, 2011 9:39:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Research Log: Updates from the Harvard Team

You need to toy a bit and sort the processes by CPU% and CPU Avg and only specify rules for those that use the CPU at a high percent and ignore those that don't. Just fired up my copy 3.99.99 alpha. Not updated for a long time as it does things as I like it... no need to fix things not broken. DON'T use the number of process limiter. That could kill a running task and cause it to be reported as a user abort.

CEP2 number of cached tasks is specified in the website device profile, custom section. It's the only WCG science that allows to specify how many a client can have ''in progress'' and combo'd with PL an ideal companion to manage the individual core loads.

--//--

looks I need to RTFM :-) in linux there's command "top" which will do the job, but in windows - I'm not that sure :-) give me a bit time to play around.

and BTW - does PL allow to assign CPU affinity and change process priority based on CPU usage? that would be cool lol
----------------------------------------
[Edit 1 times, last edit by Former Member at Mar 1, 2011 3:45:04 AM]
[Mar 1, 2011 3:18:33 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Research Log: Updates from the Harvard Team

We just passed the 2.5 million grid results mark (before validation).
http://www.worldcommunitygrid.org/stat/viewProject.do?projectShortName=cep2
[Mar 1, 2011 2:25:06 PM]   Link   Report threatening or abusive post: please login first  Go to top 
gb009761
Master Cruncher
Scotland
Joined: Apr 6, 2005
Post Count: 2978
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Research Log: Updates from the Harvard Team

Hi cleanenergy, although I may be wrong, I do believe that only after the results are validated, are they added to that total.

Thus, those we've had 2,508,334 validated results (as at midday of the 1st of March 2011).
----------------------------------------

[Mar 1, 2011 2:45:11 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Research Log: Updates from the Harvard Team

You need to toy a bit and sort the processes by CPU% and CPU Avg and only specify rules for those that use the CPU at a high percent and ignore those that don't. Just fired up my copy 3.99.99 alpha. Not updated for a long time as it does things as I like it... no need to fix things not broken. DON'T use the number of process limiter. That could kill a running task and cause it to be reported as a user abort.

CEP2 number of cached tasks is specified in the website device profile, custom section. It's the only WCG science that allows to specify how many a client can have ''in progress'' and combo'd with PL an ideal companion to manage the individual core loads.

--//--

looks I need to RTFM :-) in linux there's command "top" which will do the job, but in windows - I'm not that sure :-) give me a bit time to play around.

and BTW - does PL allow to assign CPU affinity and change process priority based on CPU usage? that would be cool lol

PL has load balancing controls out the Ying/Yang so yes, based on CPU loads you can set what should have put the breaks on and even change the affinities when CPU/Mem loads go over definable thresholds ... Task Manager can be binned for good.

In Linux I've integrated another load balancer. Of the 0.2% of the total uptime not going towards crunching, 53% is used to run this kernel patch (not Torvald approved, but it's 5 lines versus his 200 lines that has gone into 2.6.38)

Now it up to you to do the experimenting or move the discussion out of this log. There's a number of recent threads with Linux trickeries to automate affinity and priority, though latter I regard as pointless. BOINC will use 100% of spare cycles anyhow if set to run at max.
[Mar 1, 2011 2:58:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Research Log: Updates from the Harvard Team

Hi gb009761,

you are right, I was imprecise in what I said. What I meant to say is that this number includes the redundant copies.

Best wishes

Your Harvard CEP team
[Mar 1, 2011 3:00:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Research Log: Updates from the Harvard Team

Think gb009761 meant that there's also thousands of results that have not been counted yet since stuck in the much maligned PV Jail, waiting on the wingmen. Consider that on average at end of day I've got probably 3 or 4 CEP2 tasks in that state. knreed would know a project average. Maybe the equivalent of 1 production day as a wild guess, maybe less. A very old number at WCG is that over 90% is validated after 4 days from submission. No clue if this improved over the past several years and if this varies per-science, those without redundancy probably having a much smaller PV jail inmateship.

--//--
[Mar 1, 2011 3:13:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Research Log: Updates from the Harvard Team

Johannes pitched CEP2 to the Graduate Student and Postdoc Council of the Harvard Department of Chemistry and Chemical Biology today (…in another pizza fueled meeting cool ).
http://www.chem.harvard.edu/resources/council.php
[Mar 2, 2011 5:54:49 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Research Log: Updates from the Harvard Team

Dear Aaron, Lawrence, and others,
We had actually ordered business cards with the CEP2 essentials a few days ago and they should be in the mail any day now cool .
Is something whacked on my machine and Im generating a bunch of garbage or what?

Don’t worry – we have so far only seen problems in a tiny fraction of returned results (a few dozen out of more than a million). Short wus are not uncommon – whenever a calc cannot reach convergence (which just happens sometimes), the consecutive jobs are skipped and the partial wu is returned early. But what you describe wrt wall clock vs cpu time is rather curious.
We btw don’t see data as ‘good’, ‘fair’, ... – it is more about the data being more or less detailed or complete. But here is the thing: We are in principle screening an infinite chemical space (i.e., there are infinitely many potential candidate structures) with a large but ultimately finite resource (i.e., the WCG). So our study is necessarily incomplete and that is perfectly fine. The way we pick our molecules and designed our wus is simply geared towards making the most of the donated computing time within these limitations.
I checked my stats and it showed that I detatched from a bunch of projects yesterday. I did not.

That is destiny telling you to focus on CEP2 – just kidding biggrin . But we are glad that Lawrence and SekeRob could clear this up.

Dear martianmoons,
There will be a CEP2 podcast in the near future – we’ll keep you posted on the details.

Best wishes from
Your Harvard CEP team
[Mar 3, 2011 3:07:10 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Research Log: Updates from the Harvard Team

CEP2 has now passed CEP1 in all stat categories, i.e., run time, points generated, and results returned.
www.worldcommunitygrid.org/stat/viewProject.do?projectShortName=cep2
[Mar 3, 2011 3:10:27 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 1840   Pages: 184   [ Previous Page | 17 18 19 20 21 22 23 24 25 26 | Next Page ]
[ Jump to Last Post ]
Post new Thread