Submit Your CMD.PHP vs. SPINE Metrics Here

[TheWitness]

Boris hit's the 1M mark!

[exseven]

05/31/2011 03:15:15 PM - SYSTEM STATS: Time:14.1033 Method:spine Processes:2 Threads:8 Hosts:90 HostsPerProcess:45 DataSources:31971 RRDsProcessed:15059

HP ProLiant 320 G5p Xeon E3110 5GB RAM

[copo]

When the server is in it's 5min polling interval the page loads very slow, say, the page loads after 15 seconds after the click. I'm not sure if this is the disk bottleneck. This server solely for Cacti only and all the services are run on the same box include MySQL, HTTPD and RRD. The OS is installed on top of the bare hardware not VM. Any suggestion on boosting the performance? Thank you.


Operating system Redhat Linux Fedora 11
Kernel and CPU Linux 2.6.29.5-191.fc11.i686.PAE on i686
Processor information Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 4 cores (should be 2 physical CPUs)
Memory 2GB
Disks 3 x 73GB 10krpm RAID5 on IBM ServeRAID8k

07/04/2011 12:26:01 PM - SYSTEM STATS: Time:59.9841 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168
07/04/2011 12:21:06 PM - SYSTEM STATS: Time:64.6792 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168
07/04/2011 12:16:07 PM - SYSTEM STATS: Time:64.9832 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168

[TheWitness]

When the server is in it's 5min polling interval the page loads very slow, say, the page loads after 15 seconds after the click. I'm not sure if this is the disk bottleneck. This server solely for Cacti only and all the services are run on the same box include MySQL, HTTPD and RRD. The OS is installed on top of the bare hardware not VM. Any suggestion on boosting the performance? Thank you.


Operating system Redhat Linux Fedora 11
Kernel and CPU Linux 2.6.29.5-191.fc11.i686.PAE on i686
Processor information Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 4 cores (should be 2 physical CPUs)
Memory 2GB
Disks 3 x 73GB 10krpm RAID5 on IBM ServeRAID8k

07/04/2011 12:26:01 PM - SYSTEM STATS: Time:59.9841 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168
07/04/2011 12:21:06 PM - SYSTEM STATS: Time:64.6792 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168
07/04/2011 12:16:07 PM - SYSTEM STATS: Time:64.9832 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168

Use boost.

[copo]

Thank you for the information. "Boost" seems to use memory for temporary storing poll results to reduce disk IO is that right? If that is correct will 2GB which is currently installed ok with that? We are willing to place more memory into the box but I'm thinking if we should try the plugin before hardware upgrade or we should add memory before using boost. Thanks.

[rudw0lf]

Operating system Oracle Linux 6.1
Kernel and CPU 2.6.32-131.17.1.el6.x86_64
Processor information Intel(R) Xeon(R) CPU E5335 @ 2.00GHz, 4 cores
Memory 2GB
On Hyper-V

Cacti 0.8.7h
Cacti OS unix
SNMP Version NET-SNMP version: 5.5.1
RRDTool Version RRDTool 1.3.x
Hosts 205
Graphs 3433
Data Sources Script/Command: 57
SNMP: 780
SNMP Query: 2754
Script Query: 18
Script - Script Server (PHP): 6
Script Query - Script Server: 142
Total: 3757

Poller Information
Interval 60
Type SPINE 0.8.7h Copyright 2002-2011 by The Cacti Group
Items Action[0]: 6462
Action[1]: 140
Action[2]: 178
Total: 6780
Concurrent Processes 24
Max Threads 60
PHP Servers 25
Script Timeout 30
Max OID 40
Last Run Statistics Time:19.9608 Method:spine Processes:24 Threads:60 Hosts:196 HostsPerProcess:9 DataSources:2027 RRDsProcessed:1113

PHP Version 5.3.3
PHP OS Linux
PHP SNMP Installed
max_execution_time 30
memory_limit 256M

[TheWitness]

Operating system Oracle Linux 6.1
Kernel and CPU 2.6.32-131.17.1.el6.x86_64
Processor information Intel(R) Xeon(R) CPU E5335 @ 2.00GHz, 4 cores
Memory 2GB
On Hyper-V

Cacti 0.8.7h
Cacti OS unix
SNMP Version NET-SNMP version: 5.5.1
RRDTool Version RRDTool 1.3.x
Hosts 205
Graphs 3433
Data Sources Script/Command: 57
SNMP: 780
SNMP Query: 2754
Script Query: 18
Script - Script Server (PHP): 6
Script Query - Script Server: 142
Total: 3757

Poller Information
Interval 60
Type SPINE 0.8.7h Copyright 2002-2011 by The Cacti Group
Items Action[0]: 6462
Action[1]: 140
Action[2]: 178
Total: 6780
Concurrent Processes 24
Max Threads 60
PHP Servers 25
Script Timeout 30
Max OID 40
Last Run Statistics Time:19.9608 Method:spine Processes:24 Threads:60 Hosts:196 HostsPerProcess:9 DataSources:2027 RRDsProcessed:1113

PHP Version 5.3.3
PHP OS Linux
PHP SNMP Installed
max_execution_time 30
memory_limit 256M

Your max_connections better by > 1500 with such aggressive settings here. Seem's to be excessive IMHO.

[rudw0lf]

But it works - graphs without interruption.

[Joost]

Time:8.4368 Method:spine Processes:8 Threads:8 Hosts:258 HostsPerProcess:33 DataSources:40150 RRDsProcessed:15208

[BorisL]

02/09/2012 11:58:45 AM - SYSTEM STATS: Time:104.4574 Method:spine Processes:1 Threads:128 Hosts:2889 HostsPerProcess:2889 DataSources:2001681 RRDsProcessed:0
02/09/2012 12:03:50 PM - SYSTEM BOOST STATS: Time:1216.9600 RRDUpdates:21977438

[gandalf]

... DataSources:2001681 ... RRDUpdates:21977438

You shouldn't crawl the internet using Cacti
R.

[chadd]

[quote="atalatlae"]01/19/2011 06:17:35 PM - SYSTEM STATS: Time:18.5439 Method:spine Processes:6 Threads:1 Hosts:1071 HostsPerProcess:179 DataSources:40261 RRDsProcessed:18555
01/19/2011 06:16:33 PM - SYSTEM STATS: Time:16.8406 Method:spine Processes:6 Threads:1 Hosts:1071 HostsPerProcess:179 DataSources:40263 RRDsProcessed:19515

4 servers collect data
1 database with poller.php modified by me.

seya ![/quote]

If you could provide a short tutorial on how this is done, I would be grateful! I would like to offload polling to another box if possible. Actually, what would be great is if I could do an active/active Cacti server scenario. That way, I could meet DR requirements at the same time as reduce load on my one server.

I would also like to be able to go to 1min polling, or less on a case by case basis.. That I am sure is another discussion all together, but one I think the community should have. Right now we are using PRTG for sub 5min polling, on an as needed basis. In case your asking "WHY??", it is to make spikes in the datacenter visible - as Cacti, with 5min intervals tends to smooth the spikes out.

Any direction would be great! Thanks,

-chadd.

[lmn40227]

I have limited threads to 30 in the latest version. How is performance affected when you reduce threads to 30? Also, please post the number of snmp, vs. scripts, vs. script_server DS's of those 37k (Action 0, Action 1, Action 2).

[hmorandell]

Tech info:


Cacti Version 0.8.8
Cacti OS unix
SNMP Version NET-SNMP version: 5.4.2.1
RRDTool Version RRDTool 1.3.x
Hosts 1356
Graphs 4076
Data Sources Script/Command: 199
SNMP: 270
SNMP Query: 3780
Script - Script Server (PHP): 4
Total: 4253
Poller Information
Interval 60
Type SPINE 0.8.7i Copyright 2002-2011 by The Cacti Group
Items Action[0]: 7594
Action[1]: 199
Action[2]: 4
Total: 7797
Concurrent Processes 1
Max Threads 50
PHP Servers 8
Script Timeout 35
Max OID 30
Last Run Statistics Time:57.0832 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7780 RRDsProcessed:4168
PHP Information
PHP Version 5.3.3
PHP OS Linux
PHP uname Linux hdtest 2.6.31.14-0.8-default #1 SMP 2011-04-06 18:09:24 +0200 i686
PHP SNMP Installed
max_execution_time 120
memory_limit 256M


Hardware is:
RAM: 2GB
CPU: Intel(R) Xeon(TM) CPU 2.40GHz


this is cacti performance:

04/11/2012 08:36:48 AM - SYSTEM STATS: Time:46.5914 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7780 RRDsProcessed:4168
04/11/2012 08:35:53 AM - SYSTEM THOLD STATS: Time:6.7310 Tholds:590 DownHosts:0
04/11/2012 08:35:46 AM - SYSTEM STATS: Time:44.6788 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7782 RRDsProcessed:4172
04/11/2012 08:34:57 AM - SYSTEM THOLD STATS: Time:6.7515 Tholds:590 DownHosts:0
04/11/2012 08:34:50 AM - SYSTEM STATS: Time:48.4414 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7779 RRDsProcessed:4169
04/11/2012 08:33:56 AM - SYSTEM THOLD STATS: Time:6.3436 Tholds:590 DownHosts:0
04/11/2012 08:33:50 AM - SYSTEM STATS: Time:48.9084 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7778 RRDsProcessed:4168
04/11/2012 08:33:00 AM - SYSTEM THOLD STATS: Time:6.2729 Tholds:590 DownHosts:0
04/11/2012 08:32:53 AM - SYSTEM STATS: Time:49.3778 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7778 RRDsProcessed:4168
04/11/2012 08:32:12 AM - SYSTEM THOLD STATS: Time:12.3947 Tholds:590 DownHosts:0
04/11/2012 08:31:59 AM - SYSTEM STATS: Time:57.0832 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7780 RRDsProcessed:4168
04/11/2012 08:31:03 AM - SYSTEM THOLD STATS: Time:6.8977 Tholds:590 DownHosts:0
04/11/2012 08:30:56 AM - SYSTEM STATS: Time:54.7367 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7782 RRDsProcessed:4172

*******************
sorry - I can't get BB code to work, so formatting of post is not very well....

[_raindrop18]

I am preparing to build new cacti 8.8 server and I need some feedback what I should improve on hardware side or any other setup. currently running on VM. thanks.

Date Tue, 17 Apr 2012 08:47:36 -0700
Cacti Version 0.8.7e
Cacti OS unix
SNMP Version NET-SNMP version: 5.4.2.1
RRDTool Version RRDTool 1.2.x
Hosts 589
Graphs 3144
Data Sources Script/Command: 426
SNMP: 771
SNMP Query: 1970
Script Query: 10
Script - Script Server (PHP): 167
Script Query - Script Server: 5
Total: 3349
Poller Information
Interval 300
Type spine
Items Action[0]: 4585
Action[1]: 285
Action[2]: 167
Total: 5037
Concurrent Processes 5
Max Threads 20
PHP Servers 5
Script Timeout 25
Max OID 10
Last Run Statistics Time:33.3697 Method:spine Processes:5 Threads:20 Hosts:545 HostsPerProcess:109 DataSources:5037 RRDsProcessed:3044
PHP Information
PHP Version 5.2.8
PHP OS SunOS
PHP uname SunOS server-1 5.10 Generic_144488-11 sun4v
PHP SNMP Not Installed
max_execution_time 60
memory_limit 128M