Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 24
Posts: 24   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 4168 times and has 23 replies Next Thread
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
sad Re: First impressions

Are you sure it's not all running on 1 core?

Looked in and saw on Vista

1 CEP 2:12 hours into job with 2:56 minutes Kernel time and about 5k PF Delta, which seems lower than the 7k or so previously observed

3 FAAH, 1 running 6 hours shows 17 seconds kernel time and zero PF delta.

You almost made me happy Jean sad
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Feb 6, 2009 12:31:39 PM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: First impressions

Are you sure it's not all running on 1 core?

I hope you have forgotten some smiley, otherwise I would have to call Tedi... smile

That's precisely because I know how much CEP is "page-faulting" in Windows that I had my first good surprise.
And the second surprise is related to your many posts giving high kernel times (which seem normal with so much page faulting).

I should add that I was surprised by the 27 % system with four HCCs. I don't remember having noticed such a high figure in the past. But honestly I don't start top in Linux as often as I do with TM in Windows. And perhaps my recent upgrade of Ubuntu from 804 to 810 has changed something in this area?

Cheers. Jean.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Feb 6, 2009 1:52:47 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Dark Angel
Veteran Cruncher
Australia
Joined: Nov 11, 2005
Post Count: 728
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: First impressions

I never looked before but on this system (Opteron 185, Ubuntu 8.04 x64) with CEP on both cores I'm getting 2.8% system. I'm not sure which readout refers to page faults though as I don't remember the last time I looked for that.
----------------------------------------

Currently being moderated under false pretences
[Feb 6, 2009 9:17:48 PM]   Link   Report threatening or abusive post: please login first  Go to top 
widdershins
Veteran Cruncher
Scotland
Joined: Apr 30, 2007
Post Count: 677
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: First impressions

Are you sure it's not all running on 1 core?

Looked in and saw on Vista

1 CEP 2:12 hours into job with 2:56 minutes Kernel time and about 5k PF Delta, which seems lower than the 7k or so previously observed

3 FAAH, 1 running 6 hours shows 17 seconds kernel time and zero PF delta.

You almost made me happy Jean sad


I've just started on two CEP units on my quad core machine running Kbuntu 8.something (not sure what the number is, the previous one to the current one - whatever it is). The other two cores are running DDT units ATM.

As you can probably guess I'm not a hardcore linux geek, and hadn't heard of the top command until now blushing - I usually use the graphical process monitor KSysGuard if I want to see what's running. I use Linux cause it works and doesn't hog all my resources, crash, get polluted with nasties, etc. I've had my fill of fixing MS machines that have gone wonky.

Anyways, I tried out top, added the page fault view option and I can confirm Jeans view of low page faults. Now this may not apply in all circumstances, perhaps I was lucky with these two units but the fault count seems pretty reasonable. I've copied the figures below and included my highest page faulting process for comparison.

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME P nFLT COMMAND
6433 boinc 39 19 244m 25m 2152 R 99 0.8 61:45 3 1 wcgrid_cep1_6.2
6436 boinc 39 19 277m 87m 976 R 100 2.9 61:36 1 1 wcg_dddt_autodo
7113 boinc 39 19 277m 107m 1040 R 99 3.6 50:46 0 1 wcg_dddt_autodo
7158 boinc 39 19 257m 35m 2172 R 100 1.2 34:05 2 1 wcgrid_cep1_6.2
7153 boinc 39 19 277m 106m 1032 S 0 3.5 7:45 2 1 wcg_dddt_autodo
5573 root 20 0 409m 49m 10m S 1 1.6 0:48 3 171 Xorg


The "P" column is the core it is running on and nFLT seems to suggest a single page fault has happened on BOINC work in the past hour whilst running at 100% load for all that time. Doesn't seem too bad to me.

If it's of interest here's my boinc setup:

Starting BOINC client version 5.10.45 for x86_64-pc-linux-gnu
Libraries: libcurl/7.18.0 OpenSSL/0.9.8g zlib/1.2.3.3 libidn/1.1
Processor: 4 GenuineIntel Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz [Family 6 Model 15 Stepping 11]
Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc
arch_perfmon pebs bts rep_good pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr lahf_lm
OS: Linux: 2.6.24-23-generic
Memory: 2.95 GB physical, 8.65 GB virtual


Mabye CEP is just more sensitive to the config of the rig it's running on than most projects?
----------------------------------------
[Edit 1 times, last edit by widdershins at Feb 6, 2009 9:37:20 PM]
[Feb 6, 2009 9:35:01 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: First impressions

Sorry, widdershins, that's no use at all. top only shows hard page faults (ones that require a disk read). The kernel time issue is caused by soft page faults.
[Feb 6, 2009 10:15:58 PM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: First impressions

top only shows hard page faults

Thanks for reacting! That's why I asked for a trained Linux user's supervision... biggrin
And which tool should I use to see soft page faults?
Although it seems that it is HCC which is affected by this problem more than CEP under Linux. Unless I have also taken the wrong figures for system % in top's summary?

Cheers. Jean.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Feb 7, 2009 12:34:09 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: First impressions

I can't remember. We went through all this about a year ago.

I'll get back to you.
[Feb 7, 2009 12:44:55 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: First impressions

I was looking in the wrong place. I had this discussion on IRC. Logs are my friend.

Anyway, the command is sar. It is dependant on the sysstat service. So, you need something like:

/etc/init.d/sysstat start
(wait for it to collect data)
sar -B 3 4
[Feb 7, 2009 2:53:43 AM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3716
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: First impressions

OK, thank you for the tip Didactylos.

So I could see real soft page faults counts and they were in the same range as under XP2 SP3 for the same machine, i.e. about 8,000 per second and per task.
And I could also see why HCC is causing so much kernel time: about 135,000 soft page faults per second per task, which makes CEP a modest player in this annoying game.
And while one CEP task adds about 0.5 % to the kernel time one HCC task adds about 5.7 %!

Regarding results I have been distributed 11 WUs in total for this Linux experiment.
8 have been returned with a clean Result Log and 3 with the "Failed to open either source or destination files while copying wcgrestart.rst to ../../projects/www.worldcommunitygrid.org" message. But as I reported in this separate thread Valid failing WU(s) those three failing WUs are considered as Valid from a crunching viewpoint by the validators and get normal credits accordingly.

Cheers. Jean.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Feb 8, 2009 12:56:03 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Linux CEP results

I've upgraded some machines to Lenny and suprise:
It contains boinc_client version 6.2.14!! smile
Still not 6.2.15 thow, but much better than the 5.4.11 from Etch.
[Feb 10, 2009 11:35:58 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 24   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread