poller warnings and Nagios question

zia · Post by **zia** » Thu Dec 06, 2007 7:36 pm

Hi Geeks,
I have installed Cacti 0.8.7a, and here are the poller.php warnings when it run through CRON. It's installed on Solaris9, wonder why it tries to look into /proc/meminfo, mysterious?

12/07/2007 11:19:45 AM - POLLER: Poller[0] DEBUG: Poller Int: '300', Cron Int: '300', Time Since Last: '1052', Max Runtime '298', Poller Runs: '1'
12/07/2007 11:19:45 AM - POLLER: Poller[0] WARNING: Cron is out of sync with the Poller Interval! The Poller Interval is '300' seconds, with a maximum of a '300' second Cron, but 1052 seconds have passed since the last poll!
Waiting on 1/1 pollers.
cat: cannot open /proc/meminfo
cat: cannot open /proc/meminfo
usage: ps [ -aAdeflcjLPy ] [ -o format ] [ -t termlist ]
[ -u userlist ] [ -U userlist ] [ -G grouplist ]
[ -p proclist ] [ -g pgrplist ] [ -s sidlist ]
'format' is one or more of:
user ruser group rgroup uid ruid gid rgid pid ppid pgid sid taskid
pri opri pcpu pmem vsz rss osz nice class time etime stime
f s c lwp nlwp psr tty addr wchan fname comm args projid project pset
usage: ps [ -aAdeflcjLPy ] [ -o format ] [ -t termlist ]
[ -u userlist ] [ -U userlist ] [ -G grouplist ]
[ -p proclist ] [ -g pgrplist ] [ -s sidlist ]
'format' is one or more of:
user ruser group rgroup uid ruid gid rgid pid ppid pgid sid taskid
pri opri pcpu pmem vsz rss osz nice class time etime stime
f s c lwp nlwp psr tty addr wchan fname comm args projid project pset
OK u:0.00 s:0.01 r:1.02
OK u:0.00 s:0.01 r:1.02
12/07/2007 11:19:47 AM - SYSTEM STATS: Time:1.2096 Method:cmd.php Processes:1 Threads:N/A Hosts:4 HostsPerProcess:4 DataSources:29 RRDsProcessed:25
OK u:0.00 s:0.01 r:1.04
OK u:0.00 s:0.01 r:1.04
OK u:0.00 s:0.01 r:1.04
OK u:0.00 s:0.01 r:1.04
OK u:0.00 s:0.01 r:1.04
OK u:0.00 s:0.01 r:1.04
OK u:0.00 s:0.01 r:1.04

Just trimmed the remaining OK log.

Also in addition to above warnings , I want to use data collected by Nagios (nagios_service/host_performance log) to be graphed by CACTI.
Has someone got any script/utility/plugin to grab data from Nagios performance logs in rrd format.

Following are the exteacts from Nagious performance log

[SERVICEPERFDATA] 1196987356 ddclds01a Check Load 0.031 0.203 OK - load average: 0.00, 0.03, 0.07 load1=0.000;2.000;4.000;0; load5=0.027;2.500;5.000;0; load15=0.070;3.000;6.000;0;
[SERVICEPERFDATA] 1196987386 ddclds01a /opt Partition 0.025 0.073 DISK CRITICAL - free space: /opt 513 MB (1% inode=92%): /opt=45415MB;44072;45464;0;46392
[SERVICEPERFDATA] 1196987386 ddclds01a Check Running Process 0.175 0.090 PROCS OK: 83 processes with STATE = RSZDT
[SERVICEPERFDATA] 1196987436 ddclds01a Local Users 0.018 0.103 USERS OK - 6 users currently logged in users=6;100;300;0
[SERVICEPERFDATA] 1196987456 ddclds01a PING 4.033 0.004 PING OK - Packet loss = 0%, RTA = 0.00 ms
[SERVICEPERFDATA] 1196987476 ddclds01a SSH 0.019 0.123 SSH OK - Sun_SSH_1.0.1 (protocol 2.0)
[SERVICEPERFDATA] 1196987506 ddclds01a swap Partition 0.026 0.003 SWAP OK - 100% free (8193 MB out of 8193 MB) swap=8193MB;7374;6554;0;8193
[SERVICEPERFDATA] 1196987536 ddclds01a / Partition 0.025 0.233 DISK OK - free space: / 3258 MB (32% inode=86%): /=6692MB;8040;9

Please help.

Regards,
Zia-ul-Hassan

zia · Post by **zia** » Thu Dec 06, 2007 11:09 pm

In addition to what I cited above , I am getting empty graphs. Please see the output of rrdtool, when it's run manually from command line
[root@ddclds01a:/usr/local/cacti/scripts]# /usr/local/rrdtool-1.2.23/bin/rrdtool dump ~cacti/rra/cis_lab_v240_mem_buffers_40.rrd
<rrd> <version> 0003 </version>
<step> 300 </step> 
<lastupdate> 1196999216 </lastupdate> 

<ds>
<name> mem_buffers </name>
<type> GAUGE </type>
<minimal_heartbeat> 600 </minimal_heartbeat>
<min> 0.0000000000e+00 </min>
<max> NaN </max>


<last_ds> U </last_ds>
<value> NaN </value>
<unknown_sec> 116 </unknown_sec>
</ds>

 <rra>
<cf> AVERAGE </cf>
<pdp_per_row> 1 </pdp_per_row> 

<params>
<xff> 5.0000000000e-01 </xff>
</params>
<cdp_prep>
<ds>
<primary_value> NaN </primary_value>
<secondary_value> NaN </secondary_value>
<value> NaN </value>
<unknown_datapoints> 0 </unknown_datapoints>
</ds>
</cdp_prep>
<database>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>

 <row><v> NaN </v></row>
</database>
</rra>
</rrd>

Is it a bug, or I have misconfigured something? Please advise.

Regards,
Zia-ul-Hassan

Post by **gandalf** » Sat Dec 08, 2007 8:28 am

zia wrote:cat: cannot open /proc/meminfo
cat: cannot open /proc/meminfo

It seems you're using a local linux host template. That uses some linux specific commands to get meminfo. Those are not valid for Solaris. Use ucd/net snmp host template instead. It fetches meminfo via snmp
Reinhard

zia · Post by **zia** » Sun Dec 09, 2007 5:32 pm

Hi Gandalf,
What about NaN errors? Now all of my graphs are blank. I tried to follow up instructions from Howtos and got rid of this problem on Friday; but at weekend it appeared again.

Any thoughts?

Zia

zia · Post by **zia** » Sun Dec 09, 2007 8:31 pm

Hi Gandalf,

Another addition to my previos reply. I removed previous graphs and data sources for one of my hosts and added them again , but still getting no data in graphs, is displaying NAN error for Minimum,Maximum and Average.

I can see following in the log file
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[7] DS[94] SNMP: v1: ddclds01a, dsname: load_15min, oid: .1.3.6.1.4.1.2021.10.1.3.3, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[7] DS[95] SNMP: v1: ddclds01a, dsname: load_5min, oid: .1.3.6.1.4.1.2021.10.1.3.2, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[45] SNMP: v1: ddclsr01a, dsname: cpu_nice, oid: .1.3.6.1.4.1.2021.11.51.0, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[46] SNMP: v1: ddclsr01a, dsname: cpu_system, oid: .1.3.6.1.4.1.2021.11.52.0, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[47] SNMP: v1: ddclsr01a, dsname: cpu_user, oid: .1.3.6.1.4.1.2021.11.50.0, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[48] SNMP: v1: ddclsr01a, dsname: load_1min, oid: .1.3.6.1.4.1.2021.10.1.3.1, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[49] SNMP: v1: ddclsr01a, dsname: load_15min, oid: .1.3.6.1.4.1.2021.10.1.3.3, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[50] SNMP: v1: ddclsr01a, dsname: load_5min, oid: .1.3.6.1.4.1.2021.10.1.3.2, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[51] SNMP: v1: ddclsr01a, dsname: mem_buffers, oid: .1.3.6.1.4.1.2021.4.14.0, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[52] SNMP: v1: ddclsr01a, dsname: mem_cache, oid: .1.3.6.1.4.1.2021.4.15.0, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[53] SNMP: v1: ddclsr01a, dsname: mem_free, oid: .1.3.6.1.4.1.2021.4.6.0, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[56] CMD: perl /usr/local/cacti/scripts/ping.pl ddclsr01a, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[58] SNMP: v1: ddclsr01a, dsname: cpu_nice, oid: .1.3.6.1.4.1.2021.11.51.0, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[59] SNMP: v1: ddclsr01a, dsname: cpu_system, oid: .1.3.6.1.4.1.2021.11.52.0, output: U
12/10/2007 12:05:01 PM - CMDPHP: Poller[0] Host[9] DS[60] SNMP: v1: ddclsr01a, dsname: cpu_user, oid: .1.3.6.1.4.1.2021.11.50.0, output: U

And rrdtool info output is

[root@ddclds01a:/usr/local/cacti/rra]# /usr/local/rrdtool-1.2.23/bin/rrdtool info /var/log/cacti/rra/cis_lab_v240_users_43.rrd
filename = "/var/log/cacti/rra/cis_lab_v240_users_43.rrd"
rrd_version = "0003"
step = 300
last_update = 1197242357
ds[users].type = "GAUGE"
ds[users].minimal_heartbeat = 600
ds[users].min = 0.0000000000e+00
ds[users].max = 5.0000000000e+02
ds[users].last_ds = "3"
ds[users].value = NaN
ds[users].unknown_sec = 257
rra[0].cf = "AVERAGE"
rra[0].rows = 600
rra[0].pdp_per_row = 1
rra[0].xff = 5.0000000000e-01
rra[0].cdp_prep[0].value = NaN
rra[0].cdp_prep[0].unknown_datapoints = 0
rra[1].cf = "AVERAGE"
rra[1].rows = 700
rra[1].pdp_per_row = 6
rra[1].xff = 5.0000000000e-01
rra[1].cdp_prep[0].value = 2.0000000000e+00
rra[1].cdp_prep[0].unknown_datapoints = 2
rra[2].cf = "AVERAGE"
rra[2].rows = 775
rra[2].pdp_per_row = 24
rra[2].xff = 5.0000000000e-01
rra[2].cdp_prep[0].value = 4.0000000000e+00
rra[2].cdp_prep[0].unknown_datapoints = 13
rra[3].cf = "AVERAGE"
rra[3].rows = 797
rra[3].pdp_per_row = 288
rra[3].xff = 5.0000000000e-01
rra[3].cdp_prep[0].value = 4.0000000000e+00
rra[3].cdp_prep[0].unknown_datapoints = 277
rra[4].cf = "MAX"
rra[4].rows = 600
rra[4].pdp_per_row = 1
rra[4].xff = 5.0000000000e-01
rra[4].cdp_prep[0].value = NaN
rra[4].cdp_prep[0].unknown_datapoints = 0
rra[5].cf = "MAX"
rra[5].rows = 700
rra[5].pdp_per_row = 6
rra[5].xff = 5.0000000000e-01
rra[5].cdp_prep[0].value = 2.0000000000e+00
rra[5].cdp_prep[0].unknown_datapoints = 2
rra[6].cf = "MAX"
rra[6].rows = 775
rra[6].pdp_per_row = 24
rra[6].xff = 5.0000000000e-01
rra[6].cdp_prep[0].value = 2.0000000000e+00
rra[6].cdp_prep[0].unknown_datapoints = 13
rra[7].cf = "MAX"
rra[7].rows = 797
rra[7].pdp_per_row = 288
rra[7].xff = 5.0000000000e-01
rra[7].cdp_prep[0].value = 2.0000000000e+00
rra[7].cdp_prep[0].unknown_datapoints = 277
[root@ddclds01a:/usr/local/cacti/rra]#
[root@ddclds01a:/usr/local/cacti/rra]# /usr/local/rrdtool-1.2.23/bin/rrdtool dump /var/log/cacti/rra/cis_lab_v240_users_43.rrd
<rrd> <version> 0003 </version>
<step> 300 </step> 
<lastupdate> 1197242357 </lastupdate> 

<ds>
<name> users </name>
<type> GAUGE </type>
<minimal_heartbeat> 600 </minimal_heartbeat>
<min> 0.0000000000e+00 </min>
<max> 5.0000000000e+02 </max>


<last_ds> 3 </last_ds>
<value> NaN </value>
<unknown_sec> 257 </unknown_sec>
</ds>

 <rra>
<cf> AVERAGE </cf>
<pdp_per_row> 1 </pdp_per_row> 

<params>
<xff> 5.0000000000e-01 </xff>
</params>
<cdp_prep>
<ds>
<primary_value> NaN </primary_value>
<secondary_value> NaN </secondary_value>
<value> NaN </value>
<unknown_datapoints> 0 </unknown_datapoints>
</ds>
</cdp_prep>
<database>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>
 <row><v> NaN </v></row>


<row><v> NaN </v></row>

and when I run poller.php through CORN, it produces following
[root@ddclds01a:/export/home/zia/scripts]# /usr/local/php/bin/php /usr/local/cacti/poller.php
12/10/2007 01:40:39 PM - POLLER: Poller[0] DEBUG: Poller Int: '300', Cron Int: '300', Time Since Last: '2138', Max Runtime '298', Poller Runs: '1'
12/10/2007 01:40:39 PM - POLLER: Poller[0] WARNING: Cron is out of sync with the Poller Interval! The Poller Interval is '300' seconds, with a maximum of a '300' second Cron, but 2138 seconds have passed since the last poll!
Waiting on 1/1 pollers.
OK u:0.01 s:0.01 r:1.03
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04
OK u:0.01 s:0.01 r:1.04

12/10/2007 01:40:41 PM - SYSTEM STATS: Time:1.2054 Method:cmd.php Processes:1 Threads:N/A Hosts:4 HostsPerProcess:4 DataSources:50 RRDsProcessed:46

Please help.

ZIA

Post by **gandalf** » Mon Dec 10, 2007 6:56 am

Please snmpwalk against .1.3.6.1.4.1.2021.10.1.3.3 et.al manually and see, if traget responds
Reinhard

zia · Post by **zia** » Mon Dec 10, 2007 6:03 pm

[root@ddclds01a:/]# LD_LIBRARY_PATH=/usr/local/ssl/lib /usr/local/net-snmp/bin/snmpwalk -v1 -c public 10.96.201.10 .1.3.6.1.4.1.2021.10.1.3.3
End of MIB

chrisgapske · Post by **chrisgapske** » Mon Dec 10, 2007 9:35 pm

Just want to see how this thread plays out.

Post by **gandalf** » Sat Dec 15, 2007 1:18 pm

zia wrote:[root@ddclds01a:/]# LD_LIBRARY_PATH=/usr/local/ssl/lib /usr/local/net-snmp/bin/snmpwalk -v1 -c public 10.96.201.10 .1.3.6.1.4.1.2021.10.1.3.3
End of MIB

??? Can you run

Code: Select all

/usr/local/net-snmp/bin/snmpwalk -v1 -c public  10.96.201.10 .1.3.6.1.4.1.2021.10.1.3.3

If End Of MIB is returned, the target is not configured to answer your snmp requests
Reinhard

zia · Post by **zia** » Mon Dec 17, 2007 9:46 pm

End of MIB was the output was seen by running
/usr/local/net-snmp/bin/snmpwalk -v1 -c public 10.96.201.10 .1.3.6.1.4.1.2021.10.1.3.3

Post by **gandalf** » Wed Dec 19, 2007 3:11 pm

That means, that the target does not respond to that SNMP OID
Reinhard

Cacti

poller warnings and Nagios question

poller warnings and Nagios question

Re: poller warnings and Nagios question

Who is online