Submit Your CMD.PHP vs. SPINE Metrics Here

[fmangeant]

Since you are likely not on Windoz, you might want to give RRDtool 1.3 a ride.

I'm using RRDtool 1.3 SVN on my Cacti test box, and polling is working fine (only a few text alignements issues).

[TheWitness]

Lol. Definately.

Larry

[frdrk]

Omg.. cactid rocks man


08/03/2007 09:45:16 AM - SYSTEM STATS: Time:14.2933 Method:cactid Processes:10 Threads:10 Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 09:40:15 AM - SYSTEM STATS: Time:14.5393 Method:cactid Processes:10 Threads:10 Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 09:35:15 AM - SYSTEM STATS: Time:14.3520 Method:cactid Processes:10 Threads:10 Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 09:30:16 AM - SYSTEM STATS: Time:14.2550 Method:cactid Processes:10 Threads:10 Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 09:25:16 AM - SYSTEM STATS: Time:14.3465 Method:cactid Processes:10 Threads:10 Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846

08/03/2007 08:47:51 AM - SYSTEM STATS: Time:170.4112 Method:cmd.php Processes:10 Threads:N/A Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:3491
08/03/2007 08:43:01 AM - SYSTEM STATS: Time:179.9425 Method:cmd.php Processes:10 Threads:N/A Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 08:38:16 AM - SYSTEM STATS: Time:194.8529 Method:cmd.php Processes:10 Threads:N/A Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 08:33:03 AM - SYSTEM STATS: Time:182.5447 Method:cmd.php Processes:10 Threads:N/A Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 08:28:10 AM - SYSTEM STATS: Time:189.3863 Method:cmd.php Processes:10 Threads:N/A Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846


System is debian4 running on Xeon 3Ghz HT with 1Gb memory. Cacti 0.8.6j and cactid 0.8.6i. Since this server was already on its knees running nagios, rancid etc etc.. this would definitely speed things up

[generic_user]

Can someone tell me when the new version of Cactid will be released on Windows Platform? Here are my current stats and I am stuck as far as increasing performance.

I was running with higher processes but getting errors from poller:
08/06/2007 01:21:24 PM - SYSTEM STATS: Time:84.0608 Method:cactid Processes:20 Threads:40 Hosts:903 HostsPerProcess:46 DataSources:17223 RRDsProcessed:0
08/06/2007 01:16:24 PM - SYSTEM STATS: Time:84.2241 Method:cactid Processes:20 Threads:40 Hosts:903 HostsPerProcess:46 DataSources:17223 RRDsProcessed:0


So i decided to search forums and after changing to recommended processes:
08/06/2007 01:32:26 PM - SYSTEM STATS: Time:145.6436 Method:cactid Processes:8 Threads:20 Hosts:903 HostsPerProcess:113 DataSources:17223 RRDsProcessed:0
08/06/2007 01:28:07 PM - SYSTEM BOOST STATS: Time:48.0393 RRDUpdates:50701
08/06/2007 01:27:19 PM - SYSTEM STATS: Time:139.4736 Method:cactid Processes:8 Threads:20 Hosts:903 HostsPerProcess:113 DataSources:17223 RRDsProcessed:0

I know faster polling speeds are possible but not sure what I am doing wrong. Here is my host info:
Cacti Version 0.8.6j
Plugin Architecture 1.1
Poller Type Cactid v0.8.6i
Server Info Windows NT 5.2
Web Server Microsoft-IIS/6.0
PHP Version 5.2.3
PHP Extensions bcmath, calendar, com_dotnet, ctype, session, filter, ftp, hash, iconv, json, odbc, pcre, Reflection, date, libxml, standard, tokenizer, zlib, SimpleXML, dom, SPL, wddx, xml, xmlreader, xmlwriter, ISAPI, ldap, mysql, snmp, sockets
MySQL Version 5.0.37-community-nt
RRDTool Version 1.2.15
SNMP Version snmpwalk [OPTIONS] AGENT [OID] Version: 5.4 Web:
Plugins Network Discovery (discovery - v0.7)
Syslog Monitoring (haloe - v0.4)
Host Info (hostinfo - v0.1)
Global Plugin Settings (settings - v0.1)
Large Site Performane Booster for Cacti (boost - v1.2)

[gandalf]

You should verify memory settings. The memory size of the boost memory table should be taken for php.ini's memory settings as well (this was discussed lately). You should definately upgrade to latest boost.
And I'm quite sure, that latest rrdtool would be better (includes fadvise precedure to avoid disk cache being filled up with unnecessary rrdtool data). Perhaps, cactid from SVN will also introduce a performance boost. I did not keep up with the latest changes, but there has been improvement as well.
Then, disk performance is cruical and enough memory for MySQL would be appreciated. There have been bigger installations than your polling faster (depending on server sizing, of course), but this depends on data retrieval methods used: SNMP is the fastest method. Scripts are way slower.
Reinhard

[TheWitness]

Can someone tell me when the new version of Cactid will be released on Windows Platform? Here are my current stats and I am stuck as far as increasing performance.

I was running with higher processes but getting errors from poller:
08/06/2007 01:21:24 PM - SYSTEM STATS: Time:84.0608 Method:cactid Processes:20 Threads:40 Hosts:903 HostsPerProcess:46 DataSources:17223 RRDsProcessed:0
08/06/2007 01:16:24 PM - SYSTEM STATS: Time:84.2241 Method:cactid Processes:20 Threads:40 Hosts:903 HostsPerProcess:46 DataSources:17223 RRDsProcessed:0


So i decided to search forums and after changing to recommended processes:
08/06/2007 01:32:26 PM - SYSTEM STATS: Time:145.6436 Method:cactid Processes:8 Threads:20 Hosts:903 HostsPerProcess:113 DataSources:17223 RRDsProcessed:0
08/06/2007 01:28:07 PM - SYSTEM BOOST STATS: Time:48.0393 RRDUpdates:50701
08/06/2007 01:27:19 PM - SYSTEM STATS: Time:139.4736 Method:cactid Processes:8 Threads:20 Hosts:903 HostsPerProcess:113 DataSources:17223 RRDsProcessed:0

I know faster polling speeds are possible but not sure what I am doing wrong. Here is my host info:
Cacti Version 0.8.6j
Plugin Architecture 1.1
Poller Type Cactid v0.8.6i
Server Info Windows NT 5.2
Web Server Microsoft-IIS/6.0
PHP Version 5.2.3
PHP Extensions bcmath, calendar, com_dotnet, ctype, session, filter, ftp, hash, iconv, json, odbc, pcre, Reflection, date, libxml, standard, tokenizer, zlib, SimpleXML, dom, SPL, wddx, xml, xmlreader, xmlwriter, ISAPI, ldap, mysql, snmp, sockets
MySQL Version 5.0.37-community-nt
RRDTool Version 1.2.15
SNMP Version snmpwalk [OPTIONS] AGENT [OID] Version: 5.4 Web:
Plugins Network Discovery (discovery - v0.7)
Syslog Monitoring (haloe - v0.4)
Host Info (hostinfo - v0.1)
Global Plugin Settings (settings - v0.1)
Large Site Performane Booster for Cacti (boost - v1.2)

Can you provide some demographics on your hosts?

Total SNMP
Total Script
Total Script Server

You can do this in System Utilities->View Poller Cache

TheWitness

[ogou]

Hi all ,

Here are my result :

08/13/2007 05:12:13 PM - SYSTEM STATS: Time:12.2505 Method:cactid Processes:2 Threads:20 Hosts:130 HostsPerProcess:65 DataSources:15766 RRDsProcessed:5982
08/13/2007 05:07:13 PM - THOLD: Poller[0] End Checking Thresholds
08/13/2007 05:07:13 PM - THOLD: Poller[0] Checking Thresholds
08/13/2007 05:07:13 PM - SYSTEM STATS: Time:12.1879 Method:cactid Processes:2 Threads:20 Hosts:130 HostsPerProcess:65 DataSources:15766 RRDsProcessed:5982
08/13/2007 05:02:14 PM - THOLD: Poller[0] End Checking Thresholds
08/13/2007 05:02:14 PM - THOLD: Poller[0] Checking Thresholds
08/13/2007 05:02:13 PM - SYSTEM STATS: Time:12.3054 Method:cactid Processes:2 Threads:20 Hosts:130 HostsPerProcess:65 DataSources:15766 RRDsProcessed:5982


Soft:
Cacti Version 0.8.6h
Cactid Version 0.8.6i
MySQL Version 5.0.37

Hard:
Dell PowerEdge BI-QuadCore Xeon 1.6Ghz
16 Go RAM
DD 146Go 15000RPM

OS : FedoraCore 7

And I'm using the 'temporary filesystem' (tmpfs) for all my RRD files !!!

Olivier

[aleu]

Guys,
What is your recommendation (#threads, etc) for the following environment:

2xIntel(R) Xeon(TM) CPU 3.00GHz
2GB RAM

The platform is used to run Cacti only.

Poller Item Stats:
SNMP 4000
Scripts 20
Script Server 600

SYSTEM STATS: Time:124.8688 Method:cactid Processes:4 Threads:40 Hosts:76 HostsPerProcess:19 DataSources:3604 RRDsProcessed:1925

I am planning to increase the number of hosts to 100.

What is your recommendation for:
Maximum Concurrent Poller Processes
Maximum Threads per Process
Number of PHP Script Servers
Script and Script Server Timeout Value
The Maximum SNMP OID's Per SNMP Get Request
?

They are currently set as 4, 40, 2, 25, 25 (in the above order).

The box runs heavily (load average: 59.02, 43.45, 35.15; Cpu(s): 59.1% us, 8.1% sy, 0.0% ni, 32.7% id, 0.0% wa) and some of the graphs do show gaps.

Thanks

[TheWitness]

Why the heavy load? Run "du ." out of the RRA directory and post your results. Do you plan any more memory.

TheWitness

[aleu]

Why the heavy load? Run "du ." out of the RRA directory and post your results. Do you plan any more memory.

TheWitness

rra# du .
5142836 .

I do not think I will be able to add memory to this server anytime soon. Would this play a significant difference?

[TheWitness]

Absolutely, if you were to have 8GB, your polling time would be under 15 seconds.

TheWitness

[aleu]

Absolutely, if you were to have 8GB, your polling time would be under 15 seconds.

TheWitness

Would this mater when using cmd.php or cactid and why? In the mean time, could you recommend what poller settings are the best for my current config?

Regards,
Aleu

[TheWitness]

I would play with 1-2 processes and no more than 20 threads on that box.

TheWitness

[aleu]

I would play with 1-2 processes and no more than 20 threads on that box.

TheWitness

Thanks, I will give it a shoot.

[copo]

I'm trying to tune the performance on my box, and I have tried some of the changes to enhance the time for processing each polling cycle. Here are my config:

IBM x346
2 x XeonMP 3G
2 x SATA software mirror
1G RAM (another 3G is coming)
Fedora 7
Cacti 0.8.6j
Plugin Architecture 1.1
RRDTool 1.2.23

Here are my time:

After change to RRDTool 1.2.999 (1.3?)

08/28/2007 12:20:33 PM - SYSTEM STATS: Time:32.6867 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4183
08/28/2007 12:15:33 PM - SYSTEM STATS: Time:32.2831 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4194
08/28/2007 12:10:34 PM - SYSTEM STATS: Time:33.1110 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4194
08/28/2007 12:05:33 PM - SYSTEM STATS: Time:32.0114 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4183
08/28/2007 12:02:50 PM - SYSTEM STATS: Time:169.4074 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4194
08/28/2007 11:55:33 AM - SYSTEM STATS: Time:32.2077 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4194
08/28/2007 11:50:33 AM - SYSTEM STATS: Time:31.9548 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4194
08/28/2007 11:45:33 AM - SYSTEM STATS: Time:31.6347 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4194

RRDTool 1.2.23

08/28/2007 11:41:46 AM - SYSTEM STATS: Time:103.5628 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4194
08/28/2007 11:37:38 AM - SYSTEM STATS: Time:157.1463 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4194
08/28/2007 11:32:58 AM - SYSTEM STATS: Time:176.2932 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4194
08/28/2007 11:27:28 AM - SYSTEM STATS: Time:146.5987 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4194
08/28/2007 11:22:29 AM - SYSTEM STATS: Time:147.8679 Method:cactid Processes:8 Threads:60 Hosts:82 HostsPerProcess:11 DataSources:13790 RRDsProcessed:4194

After changing to use the beta version of RRDTool, the time for processing each polling cycle improved dramatically. Interestingly, after a few polling cycle, I changed back to use RRDTool 1.2.23, the time used for each polling cycle keeps at the level when using 1.2.999, which is about 30-40 seconds. But start from 8am the next day, still using 1.2.23 (nothing changed), the time used for each cycle raised again to about 150 seconds again without any change. This is strange. I'm still looking for if there is anyway for performance improvement...

Thanks.