Submit Your CMD.PHP vs. SPINE Metrics Here

[ruud]

The stats : see tagline..

Server1 is polling mostly Nortel PP8600, Juniper M320 and Juniper T640 nodes, some Cisco 2500/4000's, some Nortel BPS2000's and some Nortel OM1400's.

Server 2 is polling Alcatel MPLS nodes

[spiffturk]

cmd.php was running out of time before I even finished adding all my devices (only about half of them). Using cactid from the DAG rpm repository:

02/21/2007 03:45:14 PM - SYSTEM STATS: Time:13.3540 Method:cactid Processes:1 Threads:8 Hosts:187 HostsPerProcess:187 DataSources:15830 RRDsProcessed:7807

System info:
CPU: Dual 1.8GHz Opterons (each dual-core, so effectively four procs)
Memory: 4G
Storage: NexSan SATABoy
OS: RedHat Enterprise AS 4

I'd say that's damn fast. Kudos--it's quite the improvement.

--
Will

[gandalf]

02/21/2007 03:45:14 PM - SYSTEM STATS: Time:13.3540 Method:cactid Processes:1 Threads:8 Hosts:187 HostsPerProcess:187 DataSources:15830 RRDsProcessed:7807

I woul drecommend 4-8 Processes. This should improve things a bit
Reinhard

[Snake007uk]

02/26/2007 11:20:33 AM - SYSTEM STATS: Time:28.8264 Method:cactid Processes:1 Threads:48 Hosts:55 HostsPerProcess:55 DataSources:1680 RRDsProcessed:1147


This is an IBM server

Dual Xeon 3Ghz (not sure if this is HT) so maybe 1 cpu
4gig ram


the number of hosts will increase to about ~100. How do yo wokr out Processes to thread ratio?

Snake

[TheWitness]

Cactid does not benefit as much from an increase in processes unless you have many scripts. However, never exceed 2x the number of processors.

However, please note the following: In Cactid, every process has: X Script Servers (running php servers), so your load average may go pretty high during polling. You can minimize this by decreasing the number of script servers. You must also be aware that for every thread, you have a mysql connection. So, you must insure that you have enough MySQL connections available for users plus pollers.

TheWitness

[Snake007uk]

I adjusted the setting as follows:

02/26/2007 01:05:37 PM - SYSTEM STATS: Time:31.1256 Method:cactid Processes:4 Threads:8 Hosts:55 HostsPerProcess:14 DataSources:1680 RRDsProcessed:1147
02/26/2007 01:00:37 PM - SYSTEM STATS: Time:32.8930 Method:cactid Processes:4 Threads:8 Hosts:55 HostsPerProcess:14 DataSources:1680 RRDsProcessed:1147
02/26/2007 12:55:37 PM - SYSTEM STATS: Time:31.1234 Method:cactid Processes:4 Threads:8 Hosts:55 HostsPerProcess:14 DataSources:1680 RRDsProcessed:1147
02/26/2007 12:50:51 PM - SYSTEM STATS: Time:46.6707 Method:cactid Processes:4 Threads:8 Hosts:55 HostsPerProcess:14 DataSources:1680 RRDsProcessed:1147

You can see from the picture my cacti settings.

[jay]

Hi

I have just upgraded from Cactid g to Cactid i and have noticed a massive improvement.

Cactid g

04/23/2007 11:17:52 AM - SYSTEM STATS: Time:169.0931 Method:cactid Processes:2 Threads:10 Hosts:276 HostsPerProcess:138 DataSources:4668 RRDsProcessed:2698
04/23/2007 11:12:45 AM - SYSTEM STATS: Time:160.2101 Method:cactid Processes:2 Threads:10 Hosts:276 HostsPerProcess:138 DataSources:4668 RRDsProcessed:2698
04/23/2007 11:07:56 AM - SYSTEM STATS: Time:159.2078 Method:cactid Processes:2 Threads:10 Hosts:276 HostsPerProcess:138 DataSources:4668 RRDsProcessed:2698
04/23/2007 11:04:28 AM - SYSTEM STATS: Time:262.6738 Method:cactid Processes:2 Threads:10 Hosts:276 HostsPerProcess:138 DataSources:4668 RRDsProcessed:2698


Cactid i

04/23/2007 12:05:42 PM - SYSTEM STATS: Time:41.3486 Method:cactid Processes:2 Threads:10 Hosts:276 HostsPerProcess:138 DataSources:4668 RRDsProcessed:2698
04/23/2007 12:01:01 PM - SYSTEM STATS: Time:61.0188 Method:cactid Processes:2 Threads:10 Hosts:276 HostsPerProcess:138 DataSources:4668 RRDsProcessed:2698
04/23/2007 11:55:41 AM - SYSTEM STATS: Time:41.2778 Method:cactid Processes:2 Threads:10 Hosts:276 HostsPerProcess:138 DataSources:4668 RRDsProcessed:2698
04/23/2007 11:50:39 AM - SYSTEM STATS: Time:38.9864 Method:cactid Processes:2 Threads:10 Hosts:276 HostsPerProcess:138 DataSources:4668 RRDsProcessed:2698


Any particular reason for this??

Jay

[TheWitness]

Max OID per process was a new feature that significantly improves performance over a WAN.

TheWitness

[jay]

Excellent. Glad I chose to upgrade today. Was getting concerned about poller time.

Keep up the good work

Jay

[TheWitness]

Look to boost for additional improvements. However, do not implement without first playing on a test system.

TheWitness

[sllywhtboy]

cacti 0.86i, debian 4.0, mysql 5, php 4, on vmware esx, vmware image on SAN disk.

Code: Select all

Processors  	1
Model 	Intel(R) Xeon(TM) MP CPU 3.00GHz
CPU Speed 	2.99 GHz
Cache Size 	8192 KB
Memory  	250.95 MB

Code: Select all

05/02/2007 11:01:37 AM - SYSTEM STATS: Time:96.1495 Method:cmd.php Processes:50 Threads:N/A 
05/02/2007 11:09:55 AM - SYSTEM STATS: Time:293.4143 Method:cmd.php Processes:50 Threads:N/A 
05/02/2007 11:14:08 AM - SYSTEM STATS: Time:246.9164 Method:cmd.php Processes:50 Threads:N/A 
05/02/2007 11:17:29 AM - SYSTEM STATS: Time:148.2025 Method:cactid Processes:1 Threads:50 
05/02/2007 11:22:23 AM - SYSTEM STATS: Time:141.3344 Method:cactid Processes:1 Threads:50 
05/02/2007 11:26:43 AM - SYSTEM STATS: Time:102.0479 Method:cactid Processes:2 Threads:25 
05/02/2007 11:31:22 AM - SYSTEM STATS: Time:80.0677 Method:cactid Processes:4 Threads:8 
05/02/2007 11:36:14 AM - SYSTEM STATS: Time:72.0273 Method:cactid Processes:4 Threads:8 
05/02/2007 11:41:20 AM - SYSTEM STATS: Time:78.3477 Method:cactid Processes:4 Threads:8 

no matter what cmd.php setting i chose, cactid wins.

[TheWitness]

How many hosts, rrd's and data sources?

[sllywhtboy]

How many hosts, rrd's and data sources?

sorry, cut it down for the page width.

05/02/2007 01:21:16 PM - SYSTEM STATS: Time:74.9638 Method:cactid Processes:4 Threads:8 Hosts:83 HostsPerProcess:21 DataSources:1465 RRDsProcessed:983

[nathanh]

Here are some benchmarks from a Netra T1. Using cmd.php (snmpwalk version, PHP is not linked against libsnmp).

Hosts Polled: 35
Average Time to Poll: 2 Minutes
Concurrent Processes: 10
Threads: N/A
Processor Speed: 1000 Mhz
Number of Processors: 1

05/09/2007 11:08:37 AM - SYSTEM STATS: Time:120.3463 Method:cmd.php Processes:10 Threads:N/A Hosts:35 HostsPerProcess:4 DataSources:1257 RRDsProcessed:188

After switching to cactid.

Hosts Polled: 35
Average Time to Poll: 22 seconds
Concurrent Processes: 10
Threads: 10
Processor Speed: 1000 Mhz
Number of Processors: 1

05/09/2007 12:02:30 PM - SYSTEM STATS: Time:22.0534 Method:cactid Processes:10 Threads:10 Hosts:35 HostsPerProcess:4 DataSources:1257 RRDsProcessed:180

Yeah, it took me an hour to install cactid.

[TheWitness]

For those of you who have "faster" or "multi-core" boxes, I am in the process of testing a new Cactid. It will be version J/K. Here are some early benchmarks:

4 processes
20 threads
1000 hosts
5500 rrd files

polling time: 7-12 seconds (including rrdupdates)

My benchmark for this new version is to be able to poll 10k hosts in approximately 60 seconds. If anyone is interested in testing, it is currently STABLE in SVN under BRANCH 0 8 6.

I have a few more "enhancements"/"fixes" from existing bug reports prior to official release.

Regards,

TheWitness