Cacti performance 0.8.7i with spine 0.8.7i on gentoo

[dwaines]

HI All,

Just wondering if anyone out there has a matrix which will help fine tune cacti polling ie. threads, php servers etc. I've been noticing that my load is going up every time there is a poll and also polling time is increasing.

Please see results and configuration below.

SYSTEM STATS: Time:110.5714 Method:spine Processes:4 Threads:32 Hosts:1428 HostsPerProcess:357 DataSources:32104 RRDsProcessed:0

Poller interval: 5 mins
Maximum Concurrent Poller Processes: 4
Balance Process load: Yes
Maximum Threads per Process: 32
Number of PHP Script Servers: 8
Script and Script Server Timeout Value: 35
The Maximum SNMP OID'S Per Get Request: 25

P.S. I have a quad box with 16GB of RAM

Please let me know if more information is needed.
Thanks in advance

[Linegod]

That sounds well within limits without Boost installed.

[dwaines]

Thanks for your reply....I also have boost installed and configured. Please see my boost settings below. I want to fine tune as much as possible before I start messing with mysql.

Enable on Demand RRD updating : yes
How often should boost update all RRD's : 30 minnutes
Maximum Records: 1000000
Maximum Argurement length: 2000
Memory Limit for Boost and Poller: 512 MBytes
Maximum RRD Update Script Run time: 1 Hour
Enable direct population of poller_output_boost table by spine: yes
Enable Boost Server: yes
Multiprocess Server: Yes
Enable Image caching : yes

[Linegod]

The only thing I _might_ do, is increase the memory limit.

However, I'll say once again, it seems to be operating quite well right now.

[dwaines]

Thanks for the reply. Just wondering if my boost stats seem to be operating efficiently also. Any comments will be appreciated.

08/24/2012 01:18:22 PM - SYSTEM BOOST STATS: Time:84.4000 RRDUpdates:242786
08/24/2012 12:43:19 PM - SYSTEM BOOST STATS: Time:87.9000 RRDUpdates:243072
08/24/2012 12:12:08 PM - SYSTEM BOOST STATS: Time:302.3300 RRDUpdates:243078
08/24/2012 11:36:46 AM - SYSTEM BOOST STATS: Time:276.1600 RRDUpdates:243065
08/24/2012 10:58:20 AM - SYSTEM BOOST STATS: Time:67.4600 RRDUpdates:242408

Current Boost Status
Boost On Demand Updating: Idle
Total Data Sources: 35076
Pending Boost Records: 94083
Archived Boost Records: 0
Total Boost Records: 94083
Boost Storage Statistics
Database Engine: MyISAM
Current Boost Tables Size: 33 MBytes
Avg Bytes/Record: 372 Bytes
Max Allowed Boost Table Size: Unlimited
Estimated Maximum Records: Unlimited Records
Runtime Statistics
Last Start Time: 2012-08-24 13:16:57
Last Run Duration: 1 minutes 24 seconds (5% of update frequency)
RRD Updates: 242786
Peak Poller Memory: 59.9 MBytes
Detailed Runtime Timers: RRDUpdates:242786 TotalTime:84 get_records:8.81 results_cycle:60.91 rrd_filename_and_template:27.71 rrd_lastupdate:5.31 rrdupdate:17.83 delete:7.45 timer_overhead:~2
Max Poller Memory Allowed: 1024 MBytes
Run Time Configuration
Update Frequency: 30 Minutes
Next Start Time: 2012-08-24 13:46:57
Maximum Records: 1000000 Records
Maximum Allowed Runtime: 1 Hour
Boost Server Details
Server Config Status: Enabled
Multiprocess Server: Multiple Process
Update Timeout: 30 Seconds
Server/Port: localhost@9050
Authorized Update Web Servers: 127.0.0.1
RRDtool Binary Used: /usr/bin/rrdupdate
Image Caching
Image Caching Status: Enabled
Cache Directory: /wwwjail/siteroot/htdocs/cacti/imagefiles
Cached Files: 1 Files
Cached Files Size: 22 KBytes

[Linegod]

This is the one to pay attention to:

Detailed Runtime Timers: RRDUpdates:242786 TotalTime:84 get_records:8.81 results_cycle:60.91 rrd_filename_and_template:27.71 rrd_lastupdate:5.31 rrdupdate:17.83

It looks good though.

[dwaines]

Thanks for the answers...My biggest issue now is that every time the poller runs things get slower. My system load is ok when the php poller (manage and spine) run the system load goes really high.

Dale

[Linegod]

Well, it is meant to do as much as possible as quick as possible - that will tax a system, but hardware is relatively cheap nowadays.