New and more Poller Statistics (0.8.6i based)

Post by **gandalf** » Sat Nov 25, 2006 12:27 pm

To all users of Cacti Poller Statistics: Here's a new and updated set of Templates and one single PHP Script Server file to report not only the poller statistics:
- split poller statistics into two different graphs
- new statistics on SNMP/script/script_server
- recaching stats
- upcoming: boost server stats (for use with boost server only)

Exports done on cacti 0.8.6i, so that's the lowest required release for importing. Please put the ss_poller.php into cacti's script directory and enjoy!

Reinhard

For the boost stuff: Please notice, that values will change only on a boost_server's update run. So it is normal, that you'll see bo change over a long time until the next run is scheduled.

For the statistics on SNMP/script/script_server:
Read it as follows: SNMP denotes the number of SNMP polling entries; scripts counts the number of script entries and script_server ... (will be left to you to figure out

). This will help comparing performance of different installations. In general, SNMP stuff is by far the fastest. Of course, "script" depends ...

Pumpi · Post by **Pumpi** » Mon Nov 27, 2006 4:13 am

Excellent templates.

Thanks gandalf.

fmangeant · Post by **fmangeant** » Mon Nov 27, 2006 5:28 am

Many many thanks Reinhard

Jeb · Post by **Jeb** » Tue May 22, 2007 11:52 am

Thanks ! great plugin.
But the vertical label for "Local - Cacti Poller Statistics - Objects" report "seconds" but i think is not in second

Post by **gandalf** » Tue May 22, 2007 2:40 pm

Well, I have to admit that you're quite CORRECT! Will change it one day or the other
Reinhard

Jeb · Post by **Jeb** » Thu May 24, 2007 9:07 am

Hello,

I use cacti 0.8.6i, yesturday i installed your template and all things was workign well, today i have installer boost+PIA 1.1 (i was using PIA 1.0) and since i get nothing and graphs :/

php ss_poller.php
Time:40.4134 Method:cactid Processes:8 Threads:16 Hosts:376 HostsPerProcess:47 DataSources:28971 RRDsProcessed:0
snmp:28936 script:30 script_server:5
RecacheTime:32.0775 HostsRecached:1
Time:321.7744 RRDUpdates:57689

your script seems to be working fine... do you have an idea of what can apprend ? (i have others template using scripts and they still work)

Jeb · Post by **Jeb** » Thu May 24, 2007 9:18 am

I've just seen that i have tons of
05/24/2007 04:17:15 PM - PHPSVR: Poller[0] WARNING: Function does not exist
05/24/2007 04:17:15 PM - PHPSVR: Poller[0] WARNING: PHP Script File to be included, does not exist
in log files... i don't really understand what it means

Post by **gandalf** » Thu May 24, 2007 4:02 pm

I would need log output from a DEBUG run. See second link of my signature for more infos
Reinhard

Jeb · Post by **Jeb** » Thu May 24, 2007 6:34 pm

cactid --verbosity=5 1 1
CACTID: Using cactid config file [/etc/cactid.conf]
CACTID: DEBUG: MySQL Query ID '0': 'SELECT value FROM settings WHERE name = 'path_webroot''
CACTID: DEBUG: MySQL Query ID '0': OK
CACTID: DEBUG: MySQL Query ID '1': 'SELECT value FROM settings WHERE name = 'path_cactilog''
CACTID: DEBUG: MySQL Query ID '1': OK
CACTID: DEBUG: The path_php_server variable is /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/script_server.php
CACTID: DEBUG: The path_cactilog variable is /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/log/cacti.log
CACTID: DEBUG: MySQL Query ID '2': 'SELECT value FROM settings WHERE name = 'log_destination''
CACTID: DEBUG: MySQL Query ID '2': OK
CACTID: DEBUG: The log_destination variable is 1 (FILE)
CACTID: DEBUG: MySQL Query ID '3': 'SELECT value FROM settings WHERE name = 'path_php_binary''
CACTID: DEBUG: MySQL Query ID '3': OK
CACTID: DEBUG: The path_php variable is /usr/pkg/bin/php
CACTID: DEBUG: MySQL Query ID '4': 'SELECT value FROM settings WHERE name = 'availability_method''
CACTID: DEBUG: MySQL Query ID '4': OK
CACTID: DEBUG: The availability_method variable is 2
CACTID: DEBUG: MySQL Query ID '5': 'SELECT value FROM settings WHERE name = 'ping_recovery_count''
CACTID: DEBUG: MySQL Query ID '5': OK
CACTID: DEBUG: The ping_recovery_count variable is 3
CACTID: DEBUG: MySQL Query ID '6': 'SELECT value FROM settings WHERE name = 'ping_failure_count''
CACTID: DEBUG: MySQL Query ID '6': OK
CACTID: DEBUG: The ping_failure_count variable is 2
CACTID: DEBUG: MySQL Query ID '7': 'SELECT value FROM settings WHERE name = 'ping_method''
CACTID: DEBUG: MySQL Query ID '7': OK
CACTID: DEBUG: The ping_method variable is 1
CACTID: DEBUG: MySQL Query ID '8': 'SELECT value FROM settings WHERE name = 'ping_retries''
CACTID: DEBUG: MySQL Query ID '8': OK
CACTID: DEBUG: The ping_retries variable is 1
CACTID: DEBUG: MySQL Query ID '9': 'SELECT value FROM settings WHERE name = 'ping_timeout''
CACTID: DEBUG: MySQL Query ID '9': OK
CACTID: DEBUG: The ping_timeout variable is 400
CACTID: DEBUG: MySQL Query ID '10': 'SELECT value FROM settings WHERE name = 'log_perror''
CACTID: DEBUG: MySQL Query ID '10': OK
CACTID: DEBUG: The log_perror variable is 1
CACTID: DEBUG: MySQL Query ID '11': 'SELECT value FROM settings WHERE name = 'log_pwarn''
CACTID: DEBUG: MySQL Query ID '11': OK
CACTID: DEBUG: The log_pwarn variable is 0
CACTID: DEBUG: MySQL Query ID '12': 'SELECT value FROM settings WHERE name = 'log_pstats''
CACTID: DEBUG: MySQL Query ID '12': OK
CACTID: DEBUG: The log_pstats variable is 0
CACTID: DEBUG: MySQL Query ID '13': 'SELECT value FROM settings WHERE name = 'max_threads''
CACTID: DEBUG: MySQL Query ID '13': OK
CACTID: DEBUG: The threads variable is 16
CACTID: DEBUG: MySQL Query ID '14': 'SELECT value FROM settings WHERE name = 'poller_interval''
CACTID: DEBUG: MySQL Query ID '14': OK
CACTID: DEBUG: The polling interval is the system default
CACTID: DEBUG: MySQL Query ID '15': 'SELECT value FROM settings WHERE name = 'concurrent_processes''
CACTID: DEBUG: MySQL Query ID '15': OK
CACTID: DEBUG: The number of concurrent processes is 8
CACTID: DEBUG: MySQL Query ID '16': 'SELECT value FROM settings WHERE name = 'script_timeout''
CACTID: DEBUG: MySQL Query ID '16': OK
CACTID: DEBUG: The script timeout is 25
CACTID: DEBUG: MySQL Query ID '17': 'SELECT value FROM settings WHERE name = 'php_servers''
CACTID: DEBUG: MySQL Query ID '17': OK
CACTID: DEBUG: The number of php script servers to run is 2
CACTID: DEBUG: MySQL Query ID '18': 'SELECT action FROM poller_item WHERE action=2 AND host_id BETWEEN 1 AND 1 LIMIT 1'
CACTID: DEBUG: MySQL Query ID '18': OK
CACTID: DEBUG: StartHost='1', EndHost='1', TotalPHPScripts='1'
CACTID: DEBUG: The PHP Script Server is Required
CACTID: DEBUG: MySQL Query ID '19': 'SELECT value FROM settings WHERE name = 'max_get_size''
CACTID: DEBUG: MySQL Query ID '19': OK
CACTID: DEBUG: The Maximum SNMP OID Get Size is 10
CACTID: CACTID: Version 0.8.6i starting
CACTID: MYSQL: Connecting to MySQL database 'cacti' on 'localhost'...
CACTID: MYSQL: Connected to MySQL database 'cacti' on 'localhost'...
CACTID: CACTID: Initializing Net-SNMP API
CACTID: DEBUG: SNMP Header Version is 5.3.1
CACTID: DEBUG: SNMP Library Version is 5.3.1
CACTID: CACTID: Initializing PHP Script Server(s)
CACTID: DEBUG: SS[0] PHP Script Server Routine Starting
CACTID: DEBUG: SS[0] PHP Script Server About to FORK Child Process
CACTID: DEBUG: SS[0] PHP Script Server Child FORK Success
CACTID: DEBUG: SS[0] Confirmed PHP Script Server running
CACTID: DEBUG: SS[1] PHP Script Server Routine Starting
CACTID: DEBUG: SS[1] PHP Script Server About to FORK Child Process
CACTID: DEBUG: SS[1] PHP Script Server Child FORK Success
CACTID: DEBUG: SS[1] Confirmed PHP Script Server running
CACTID: DEBUG: MySQL Query ID '20': 'SELECT id FROM host WHERE disabled='' AND id BETWEEN 1 AND 1 ORDER BY id'
CACTID: DEBUG: MySQL Query ID '20': OK
CACTID: DEBUG: Initial Value of Active Threads is 0
CACTID: DEBUG: Valid Thread to be Created
CACTID: DEBUG: The Value of Active Threads is 1
CACTID: DEBUG: In Poller, About to Start Polling of Host
CACTID: MYSQL: Connecting to MySQL database 'cacti' on 'localhost'...
CACTID: MYSQL: Connected to MySQL database 'cacti' on 'localhost'...
CACTID: DEBUG: MySQL Query ID '21': 'SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout FROM poller_item WHERE host_id=0 ORDER BY arg1'
CACTID: DEBUG: MySQL Query ID '21': OK
CACTID: Host[0] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
CACTID: DEBUG: Valid Thread to be Created
CACTID: DEBUG: The Value of Active Threads is 2
CACTID: DEBUG: In Poller, About to Start Polling of Host
CACTID: MYSQL: Connecting to MySQL database 'cacti' on 'localhost'...
CACTID: MYSQL: Connected to MySQL database 'cacti' on 'localhost'...
CACTID: DEBUG: MySQL Query ID '22': 'SELECT id, hostname, snmp_community, snmp_username, snmp_password, snmp_version, snmp_port, snmp_timeout, status, status_event_count, status_fail_date, status_rec_date, status_last_error, min_time, max_time, cur_time, avg_time, total_polls, failed_polls, availability FROM host WHERE id=1'
CACTID: DEBUG: MySQL Query ID '22': OK
CACTID: Host[1] SNMP Result: Host responded to SNMP
CACTID: DEBUG: MySQL Insert ID '0': 'update host set status='3', status_event_count='0', status_fail_date='2006-12-04 15:35:00', status_rec_date='0000-00-00 00:00:00', status_last_error='Host did not respond to SNMP', min_time='0.000000', max_time='217.263940', cur_time='0.570060', avg_time='0.015561', total_polls='48288', failed_polls='1', availability='99.9979' where id='1''
CACTID: DEBUG: MySQL Insert ID '0': OK
CACTID: DEBUG: MySQL Query ID '23': 'SELECT data_query_id, action, op, assert_value, arg1 FROM poller_reindex WHERE host_id=1'
CACTID: DEBUG: MySQL Query ID '23': OK
CACTID: Host[1] RECACHE: Processing 1 items in the auto reindex cache for '1.2.3.4'
CACTID: DEBUG: MySQL Insert ID '1': 'update poller_reindex set assert_value='3125237' where host_id='1' and data_query_id='1' and arg1='.1.3.6.1.2.1.1.3.0''
CACTID: DEBUG: MySQL Insert ID '1': OK
CACTID: DEBUG: MySQL Query ID '24': 'SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout FROM poller_item WHERE host_id=1 ORDER BY arg1'
CACTID: DEBUG: MySQL Query ID '24': OK
CACTID: Host[1] DS[29450] SS[0] SERVER: /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/scripts/ss_poller.php ss_boost, output: Time:199.9211 RRDUpdates:57705
CACTID: Host[1] DS[29394] SS[1] SERVER: /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/scripts/ss_poller.php ss_poller, output: Time:40.3910 Method:cactid Processes:8 Threads:16 Hosts:376 HostsPerProcess:47 DataSources:28975 RRDsProcessed:0
CACTID: Host[1] DS[29393] SS[0] SERVER: /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/scripts/ss_poller.php ss_poller, output: Time:40.3910 Method:cactid Processes:8 Threads:16 Hosts:376 HostsPerProcess:47 DataSources:28975 RRDsProcessed:0
CACTID: Host[1] DS[29392] SS[1] SERVER: /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/scripts/ss_poller.php ss_poller_items, output: snmp:28940 script:30 script_server:5
CACTID: Host[1] DS[29395] SS[0] SERVER: /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/scripts/ss_poller.php ss_recache, output: RecacheTime:32.0775 HostsRecached:1
CACTID: Host[1] DEBUG: The POPEN returned the following File Descriptor 11
CACTID: Host[1] DS[5] SCRIPT: perl /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/scripts/loadavg_multi.pl, output: 1min:1.89 5min:1.81 10min:2.13
CACTID: Host[1] DEBUG: The POPEN returned the following File Descriptor 11
CACTID: Host[1] DS[29396] SCRIPT: perl /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/scripts/query_unix_partitions.pl get available /dev/sd0a, output: 1070856
CACTID: Host[1] DEBUG: The POPEN returned the following File Descriptor 11
CACTID: Host[1] DS[29396] SCRIPT: perl /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/scripts/query_unix_partitions.pl get used /dev/sd0a, output: 8612786
CACTID: Host[1] DEBUG: The POPEN returned the following File Descriptor 11
CACTID: DEBUG: The Value of Active Threads is 1
CACTID: Host[1] DS[7] SCRIPT: perl /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/scripts/unix_processes.pl, output: 49
CACTID: Host[1] DEBUG: The POPEN returned the following File Descriptor 11
CACTID: Host[1] DS[6] SCRIPT: perl /usr/pkg/share/httpd/htdocs/cacti-0.8.6i/scripts/unix_users.pl , output: 3
CACTID: Host[1] DS[29451] SNMP: v2: 1.2.3.4, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.1, value: 185033901
CACTID: Host[1] DS[29452] SNMP: v2: 1.2.3.4, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.2, value: 82522640
CACTID: Host[1] DS[29451] SNMP: v2: 1.2.3.4, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.1, value: 29308058
CACTID: Host[1] DS[29452] SNMP: v2: 1.2.3.4, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.2, value: 4042788378
CACTID: DEBUG: MySQL Insert ID '2': 'INSERT INTO poller_output (local_data_id, rrd_name, time, output) VALUES (29451,'traffic_in','2007-05-25 01:15:42','185033901'),(29452,'traffic_in','2007-05-25 01:15:42','82522640'),(29451,'traffic_out','2007-05-25 01:15:42','29308058'),(29452,'traffic_out','2007-05-25 01:15:42','4042788378'),(29450,'','2007-05-25 01:15:42','Time:199.9211 RRDUpdates:57705'),(29394,'','2007-05-25 01:15:42','Time:40.3910 Method:cactid Processes:8 Threads:16 Hosts:376 HostsPerProcess:47 DataSources:28975 RRDsProcessed:0'),(29393,'','2007-05-25 01:15:42','Time:40.3910 Method:cactid Processes:8 Threads:16 Hosts:376 HostsPerProcess:47 DataSources:28975 RRDsProcessed:0'),(29392,'','2007-05-25 01:15:42','snmp:28940 script:30 script_server:5'),(29395,'','2007-05-25 01:15:42','RecacheTime:32.0775 HostsRecached:1'),(5,'','2007-05-25 01:15:42','1min:1.89 5min:1.81 10min:2.13'),(29396,'hdd_free','2007-05-25 01:15:42','1070856'),(29396,'hdd_used','2007-05-25 01:15:42','8612786'),(7,'proc','2007-05-25 01:15:42','49'),(6,'users','2007-05-25 01:15:42','3')'
CACTID: DEBUG: MySQL Insert ID '2': OK
CACTID: Host[1] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
CACTID: DEBUG: The Value of Active Threads is 0
CACTID: DEBUG: MySQL Insert ID '3': 'replace into settings (name,value) values ('date',NOW())'
CACTID: DEBUG: MySQL Insert ID '3': OK
CACTID: DEBUG: MySQL Insert ID '4': 'insert into poller_time (poller_id, start_time, end_time) values (0, NOW(), NOW())'
CACTID: DEBUG: MySQL Insert ID '4': OK
CACTID: DEBUG: Thread Cleanup Complete
CACTID: DEBUG: SS[0] Script Server Shutdown Started
CACTID: DEBUG: SS[1] Script Server Shutdown Started
CACTID: DEBUG: PHP Script Server Pipes Closed
CACTID: DEBUG: Allocated Variable Memory Freed
CACTID: CACTID: Net-SNMP API Shutdown Completed
CACTID: DEBUG: MYSQL Free & Close Completed
CACTID: Time: 2.1416 s, Threads: 16, Hosts: 2

Data are in poller_output.
I have include the graph. Note that data missing before 14H are normal because my poller was running for more than 300s some times and before lanching the poller i check that the old one has finished...

As you see in the debug, i also get interface stats using snmp for this host (since very few time, to see if it work) and i got exactly the same leak of data on interface stats (i mean leaks at same time).
I think that the problem come from boost that may miss the hostid 1 almost all time... i will try to track poller_output_boost to see if data are put in...

Jeb · Post by **Jeb** » Thu May 24, 2007 6:35 pm

in fact i think that rrd_name should not be empty :/
is it possible that because poller stats fail all data for the host_id are not proceded ?

Jeb · Post by **Jeb** » Fri May 25, 2007 6:11 am

I caught the bug !!
In fact, i left my broswer open on the host graphs.
So that every time the page reload, boost should update RRAs before making the graph.
Whats append is that data are removed from poller_output_boost but RRAs are not updated... so i loose data.

Edit: i found why, my webserver has not write right on rrds, so stupid error from me...

BSOD2600 · Post by **BSOD2600** » Wed Jun 06, 2007 3:03 pm

Just got a new cacti 0.8.6j + patches server up and your updated templates installed. Using rrdtool 1.2.15 on Win2K3. Ran into the following error for a graph template, probably should update it...

Code: Select all

RRDTool Command:

c:/rrdtool/rrdtool.exe graph - \
--imgformat=PNG \
--start=-86400 \
--end=-300 \
--title="Local - Cacti Poller Statistics - Runtime" \
--base=1000 \
--height=120 \
--width=500 \
--alt-autoscale-max \
--lower-limit=0 \
--vertical-label="seconds" \
--slope-mode \
DEF:a="C\:/Inetpub/wwwroot/cacti/rra/localhost_poller_stats_1.rrd":Time:AVERAGE \
DEF:b="C\:/Inetpub/wwwroot/cacti/rra/localhost_poller_stats_1.rrd":Processes:AVERAGE \
DEF:c="C\:/Inetpub/wwwroot/cacti/rra/localhost_poller_stats_1.rrd":Threads:AVERAGE \
LINE1:#FF00FF:"Poller Runtime"  \
GPRINT::LAST:"Current\:%8.2lf %s"  \
GPRINT::AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:a:MAX:"Maximum\:%8.2lf %s\n"  \
LINE1:#FFD660:"Processes"  \
GPRINT:b:LAST:"     Current\:%8.2lf %s"  \
GPRINT:b:AVERAGE:"     Average\:%8.2lf %s"  \
GPRINT:b:MAX:"     Maximum\:%8.2lf %s\n"  \
LINE1:#FFAB00:"Threads"  \
GPRINT:c:LAST:"       Current\:%8.2lf %s"  \
GPRINT:c:AVERAGE:"       Average\:%8.2lf %s"  \
GPRINT:c:MAX:"       Maximum\:%8.2lf %s\n" 

RRDTool Says:

ERROR: parameter '#FF00FF' does not represent a number in line LINE1:#FF00FF:Poller Runtime

edit: Weird. Went through and manually resaved every graph item and now it works. Below is the working command. One can see the addition of the a,b,c values...

Code: Select all

c:/rrdtool/rrdtool.exe graph - \
--imgformat=PNG \
--start=-86400 \
--end=-300 \
--title="Local - Cacti Poller Statistics - Runtime" \
--base=1000 \
--height=120 \
--width=500 \
--alt-autoscale-max \
--lower-limit=0 \
--vertical-label="seconds" \
--slope-mode \
DEF:a="C\:/Inetpub/wwwroot/cacti/rra/localhost_poller_stats_1.rrd":Time:AVERAGE \
DEF:b="C\:/Inetpub/wwwroot/cacti/rra/localhost_poller_stats_1.rrd":Processes:AVERAGE \
DEF:c="C\:/Inetpub/wwwroot/cacti/rra/localhost_poller_stats_1.rrd":Threads:AVERAGE \
LINE1:a#FF00FF:"Poller Runtime"  \
GPRINT:a:LAST:"Current\:%8.2lf %s"  \
GPRINT:a:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:a:MAX:"Maximum\:%8.2lf %s\n"  \
LINE1:b#FFD660:"Processes"  \
GPRINT:b:LAST:"     Current\:%8.2lf %s"  \
GPRINT:b:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:b:MAX:"Maximum\:%8.2lf %s\n"  \
LINE1:c#FFAB00:"Threads"  \
GPRINT:c:LAST:"       Current\:%8.2lf %s"  \
GPRINT:c:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:c:MAX:"Maximum\:%8.2lf %s\n"

Another thing you might consider for the next update is to change the graph templates to use |host_description| instead of Local for the title.

timi · Post by **timi** » Thu Jun 07, 2007 2:01 am

can I use it under cacti 0.8.6h ?

Post by **gandalf** » Thu Jun 07, 2007 4:45 pm

Yes, you can use the script. But you would have to create the graphs on your own, because import will fails on downloevel systems
Reinhard

Mika2006 · Post by **Mika2006** » Wed Jun 20, 2007 10:07 am

Hello what means this graphique please?

New and more Poller Statistics (0.8.6i based)

New and more Poller Statistics (0.8.6i based)

Who is online