A little help with possibly out-of-bounds values?

[bhoskins]

Hi All,

I'm looking for a little assistance debugging some graphs that are not plotting certain (higher) values for Cisco router/switch interface utilization using the default device, data, and graph templates.

This is a relatively new cacti server, installed on Windows Server 2003, using the Cacti installer that's bundled with all the various dependencies. Some data sources plot fine, while others do not. I've verified that spine is getting a valid value back from the router(s) and did a dump of the rrd file, which showed "NAN" for the values in question. I modified the maximum values within the datasource to be within bounds for the value the routers are returning, however the values are still not being plotted.

Any help pointing out what I must be obviously overlooking would be greatly appreciated.

Thanks,

B. J.

Code: Select all

! Spine runs just fine, SNMP good, router provies a value back.
!
$ ./spine -V=6 13 13

NOTE: The Shell Command Exists in the current directory

SPINE: Using spine config file [spine.conf]

09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'path_webroot''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'path_cactilog''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The path_php_server variable is g:/Apache2/htdocs/cacti/script_server.php
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The path_cactilog variable is G:/Apache2/htdocs/cacti/log/cacti.log
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'log_destination''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The log_destination variable is 1 (FILE)
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'path_php_binary''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The path_php variable is g:/php/php.exe
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'availability_method''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The availability_method variable is 2
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'ping_recovery_count''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The ping_recovery_count variable is 3
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'ping_failure_count''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The ping_failure_count variable is 2
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'ping_method''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The ping_method variable is 2
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'ping_retries''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The ping_retries variable is 1
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'ping_timeout''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The ping_timeout variable is 400
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'snmp_retries''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The snmp_retries variable is 3
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'log_perror''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The log_perror variable is 1
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'log_pwarn''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The log_pwarn variable is 0
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'boost_redirect''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The boost_redirect variable is 0
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'log_pstats''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The log_pstats variable is 0
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'max_threads''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The threads variable is 1
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'poller_interval''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The polling interval is 300 seconds
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'concurrent_processes''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The number of concurrent processes is 1
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'script_timeout''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The script timeout is 25
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'php_servers''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The number of php script servers to run is 1
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT action FROM poller_item WHERE action=2 AND host_id BETWEEN 13 AND 13 LIMIT 1'
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: StartHost='13', EndHost='13', TotalPHPScripts='0'
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The PHP Script Server is Not Required
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT value FROM settings WHERE name = 'max_get_size''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The Maximum SNMP OID Get Size is 10
SPINE: Version 0.8.7e starting
09/28/2009 10:12:08 AM - SPINE: Poller[0] SPINE: Initializing Net-SNMP API
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: SNMP Header Version is 5.4.1
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: SNMP Library Version is 5.4.1
09/28/2009 10:12:08 AM - SPINE: Poller[0] SPINE: Initializing PHP Script Server(s)
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SHOW COLUMNS FROM host LIKE 'poller_id''
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT id FROM host WHERE disabled='' AND id BETWEEN 13 AND 13 ORDER BY id'
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: Initial Value of Active Threads is 0
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT snmp_port, count(snmp_port) FROM poller_item WHERE host_id=0 AND rrd_next_step < 0 GROUP BY snmp_port'
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context  FROM poller_item WHERE host_id=0 and rrd_next_step <=0 ORDER by snmp_port'
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_next_step-300 WHERE host_id=0'
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_step-300 WHERE rrd_next_step < 0 and host_id=0'
09/28/2009 10:12:08 AM - SPINE: Poller[0] Host[0] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 0
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
09/28/2009 10:12:08 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT id, hostname, snmp_community, snmp_version, snmp_username, snmp_password, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context, snmp_port, snmp_timeout, max_oids, availability_method, ping_method, ping_port, ping_timeout, ping_retries, status, status_event_count, status_fail_date, status_rec_date, status_last_error, min_time, max_time, cur_time, avg_time, total_polls, failed_polls, availability  FROM host WHERE id=13'
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] SNMP Result: Host responded to SNMP
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEVDBG: SQL:'UPDATE host SET status='3', status_event_count='0', status_fail_date='0000-00-00 00:00:00', status_rec_date='0000-00-00 00:00:00', status_last_error='', min_time='9.999990', max_time='1308.000090', cur_time='69.999930', avg_time='159.570990', total_polls='1162', failed_polls='0', availability='100.0000'WHERE id='13''
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT data_query_id, action, op, assert_value, arg1 FROM poller_reindex WHERE host_id=13'
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] RECACHE: Processing 1 items in the auto reindex cache for '170.206.105.225'
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEVDBG: SQL:'UPDATE poller_reindex SET assert_value='2231006878' WHERE host_id='13' AND data_query_id='1' and arg1='.1.3.6.1.2.1.1.3.0''
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT snmp_port, count(snmp_port) FROM poller_item WHERE host_id=13 AND rrd_next_step < 0 GROUP BY snmp_port'
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEVDBG: SQL:'SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context  FROM poller_item WHERE host_id=13 and rrd_next_step <=0 ORDER by snmp_port'
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEVDBG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_next_step-300 WHERE host_id=13'
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEVDBG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_step-300 WHERE rrd_next_step < 0 and host_id=13'
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] NOTE: There are '15' Polling Items for this Host
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[408] SNMP: v2: 170.206.105.225, dsname: traffic_in, oid: .1.3.6.1.2.1.31.1.1.1.6.110, value: 9199459550462
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[408] SNMP: v2: 170.206.105.225, dsname: traffic_out, oid: .1.3.6.1.2.1.31.1.1.1.10.110, value: 3176138558906
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[2189] SNMP: v2: 170.206.105.225, dsname: traffic_in, oid: .1.3.6.1.2.1.31.1.1.1.6.123, value: 9197198143991
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[2189] SNMP: v2: 170.206.105.225, dsname: traffic_out, oid: .1.3.6.1.2.1.31.1.1.1.10.123, value: 3173534756602
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[410] SNMP: v2: 170.206.105.225, dsname: errors_in, oid: .1.3.6.1.2.1.2.2.1.14.110, value: 594
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[410] SNMP: v2: 170.206.105.225, dsname: discards_in, oid: .1.3.6.1.2.1.2.2.1.13.110, value: 862
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[410] SNMP: v2: 170.206.105.225, dsname: discards_out, oid: .1.3.6.1.2.1.2.2.1.19.110, value: 83
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[410] SNMP: v2: 170.206.105.225, dsname: errors_out, oid: .1.3.6.1.2.1.2.2.1.20.110, value: 0
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[411] SNMP: v2: 170.206.105.225, dsname: errors_in, oid: .1.3.6.1.2.1.2.2.1.14.123, value: 1085948
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[411] SNMP: v2: 170.206.105.225, dsname: discards_in, oid: .1.3.6.1.2.1.2.2.1.13.123, value: 0
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[411] SNMP: v2: 170.206.105.225, dsname: discards_out, oid: .1.3.6.1.2.1.2.2.1.19.123, value: 0
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[411] SNMP: v2: 170.206.105.225, dsname: errors_out, oid: .1.3.6.1.2.1.2.2.1.20.123, value: U
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[871] SNMP: v2: 170.206.105.225, dsname: 1min_cpu, oid: .1.3.6.1.4.1.9.2.1.57.0, value: 4
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[872] SNMP: v2: 170.206.105.225, dsname: 5min_cpu, oid: .1.3.6.1.4.1.9.2.1.58.0, value: 4
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[873] SNMP: v2: 170.206.105.225, dsname: 5sec_cpu, oid: .1.3.6.1.4.1.9.2.1.56.0, value: 11
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEVDBG: SQL:'INSERT INTO poller_output (local_data_id, rrd_name, time, output)VALUES (408,'traffic_in','2009-09-28 10:12:08','9199459550462'),(408,'traffic_out','2009-09-28 10:12:08','3176138558906'),(2189,'traffic_in','2009-09-28 10:12:08','9197198143991'),(2189,'traffic_out','2009-09-28 10:12:08','3173534756602'),(410,'errors_in','2009-09-28 10:12:08','594'),(410,'discards_in','2009-09-28 10:12:08','862'),(410,'discards_out','2009-09-28 10:12:08','83'),(410,'errors_out','2009-09-28 10:12:08','0'),(411,'errors_in','2009-09-28 10:12:08','1085948'),(411,'discards_in','2009-09-28 10:12:08','0'),(411,'discards_out','2009-09-28 10:12:08','0'),(411,'errors_out','2009-09-2810:12:08','U'),(871,'1min_cpu','2009-09-28 10:12:08','4'),(872,'5min_cpu','2009-09-28 10:12:08','4'),(873,'5sec_cpu','2009-09-28 10:12:08','11')'
09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 0
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEVDBG: SQL:'replace into settings (name,value) values ('date',NOW())'
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEVDBG: SQL:'insert into poller_time (poller_id, start_time, end_time) values(0, NOW(), NOW())'
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEBUG: Thread Cleanup Complete
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEBUG: PHP Script Server Pipes Closed
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEBUG: Allocated Variable Memory Freed
09/28/2009 10:12:09 AM - SPINE: Poller[0] DEBUG: MYSQL Free & Close Completed
09/28/2009 10:12:09 AM - SPINE: Poller[0] Time: 0.5200 s, Threads: 1, Hosts: 2


!RRDTool reports NaN
!
<!-- 2009-09-28 10:10:00 Central Daylight Time / 1254150600 --> <row><v> NaN </v><v> 1.0423036885e+005 </v></row>
<!-- 2009-09-28 10:15:00 Central Daylight Time / 1254150900 --> <row><v> NaN </v><v> 1.0513497117e+005 </v></row>

[bhoskins]

Cacti Version - 0.8.7e
Plugin Architecture - 2.4
Poller Type - Cactid v
Server Info - Windows NT 5.2
Web Server - Apache/2.2.11 (Win32) PHP/5.2.9-2
PHP - 5.2.9-2
PHP Extensions - bcmath, calendar, com_dotnet, ctype, session, filter, ftp, hash, iconv, json, odbc, pcre, Reflection, date, libxml, standard, tokenizer, zlib, SimpleXML, dom, SPL, wddx, xml, xmlreader, xmlwriter, apache2handler, gd, ldap, mysql, snmp
MySQL - 5.0.86-community-nt
RRDTool - 1.2.30
SNMP - At line 1 in (none)
Cannot find module (NET-SNMP-AGENT-MIB): At line 1 in (none)
Cannot find module (DISMAN-EVENT-MIB): At line 1 in (none)
No hostname specified.
USAGE: snmpwalk [OPTIONS] AGENT [OID]

Version: 5.4.2.1
Web: http://www.net-snmp.org/
Email: net-snmp-coders@lists.sourceforge.net

OPTIONS:
-h, --help display this help message
-H display configuration file directives understood
-v 1|2c|3 specifies SNMP version to use
-V, --version display package version number
SNMP Version 1 or 2c specific
-c COMMUNITY set the community string
SNMP Version 3 specific
-a PROTOCOL set authentication protocol (MD5|SHA)
-A PASSPHRASE set authentication protocol pass phrase
-e ENGINE-ID set security engine ID (e.g. 800000020109840301)
-E ENGINE-ID set context engine ID (e.g. 800000020109840301)
-l LEVEL set security level (noAuthNoPriv|authNoPriv|authPriv)
-n CONTEXT set context name (e.g. bridge1)
-u USER-NAME set security name (e.g. bert)
-x PROTOCOL set privacy protocol (DES|AES)
-X PASSPHRASE set privacy protocol pass phrase
-Z BOOTS,TIME set destination engine boots/time
General communication options
-r RETRIES set the number of retries
-t TIMEOUT set the request timeout (in seconds)
Debugging
-d dump input/output packets in hexadecimal
-D TOKEN[,...] turn on debugging output for the specified TOKENs
(ALL gives extremely verbose debugging output)
General options
-m MIB[:...] load given list of MIBs (ALL loads everything)
-M DIR[:...] look in given list of directories for MIBs
-P MIBOPTS Toggle various defaults controlling MIB parsing:
u: allow the use of underlines in MIB symbols
c: disallow the use of "--" to terminate comments
d: save the DESCRIPTIONs of the MIB objects
e: disable errors when MIB symbols conflict
w: enable warnings when MIB symbols conflict
W: enable detailed warnings when MIB symbols conflict
R: replace MIB symbols from latest module
-O OUTOPTS Toggle various defaults controlling output display:
0: print leading 0 for single-digit hex characters
a: print all strings in ascii format
b: do not break OID indexes down
e: print enums numerically
E: escape quotes in string indices
f: print full OIDs on output
n: print OIDs numerically
q: quick print for easier parsing
Q: quick print with equal-signs
s: print only last symbolic element of OID
S: print MIB module-id plus last element
t: print timeticks unparsed as numeric integers
T: print human-readable text along with hex strings
u: print OIDs using UCD-style prefix suppression
U: don't print units
v: print values only (not OID = value)
x: print all strings in hex format
X: extended index format
-I INOPTS Toggle various defaults controlling input parsing:
b: do best/regex matching to find a MIB node
h: don't apply DISPLAY-HINTs
r: do not check values for range/type legality
R: do random access to OID labels
u: top-level OIDs must have '.' prefix (UCD-style)
s SUFFIX: Append all textual OIDs with SUFFIX before parsing
S PREFIX: Prepend all textual OIDs with PREFIX before parsing
-L LOGOPTS Toggle various defaults controlling logging:
e: log to standard error
o: log to standard output
n: don't log at all
f file: log to the specified file
s facility: log to syslog (via the specified facility)

(variants)
[EON] pri: log to standard error, output or /dev/null for level 'pri' and above
[EON] p1-p2: log to standard error, output or /dev/null for levels 'p1' to 'p2'
[FS] pri token: log to file/syslog for level 'pri' and above
[FS] p1-p2 token: log to file/syslog for levels 'p1' to 'p2'
-C APPOPTS Set various application specific behaviours:
p: print the number of variables found
i: include given OID in the search range
I: don't include the given OID, even if no results are returned
c: do not check returned OIDs are increasing
t: Display wall-clock time to complete the request
Plugins

• Global Plugin Settings (settings - v0.6)
  PHP Network Weathermap (weathermap - v0.96a)
  Update Checker (update - v0.4)
  Network Tools (tools - v0.3)
  Host Info (hostinfo - v0.2)

Technical Support
General Information
Date Mon, 28 Sep 2009 14:06:35 -0500
Cacti Version 0.8.7e
Cacti OS win32
SNMP Version NET-SNMP version: 5.4.2.1
RRDTool Version RRDTool 1.2.x
Hosts 311
Graphs 1476
Data Sources SNMP: 941
SNMP Query: 1163
Total: 2104
Poller Information
Interval 300
Type spine
Items Action[0]: 4317
Total: 4317
Concurrent Processes 5
Max Threads 10
PHP Servers 8
Script Timeout 25
Max OID 60
Last Run Statistics Time:6.7299 Method:spine Processes:5 Threads:10 Hosts:312 HostsPerProcess:63 DataSources:4315 RRDsProcessed:2061
PHP Information
PHP Version 5.2.9-2
PHP OS WINNT
PHP uname Windows NT IDEN-TOOLS2 5.2 build 3790
PHP SNMP Installed
max_execution_time 30
memory_limit 128M
MySQL Table Information
Name Rows Engine Collation Check Status
cdef 6 MyISAM latin1_swedish_ci OK
cdef_items 16 MyISAM latin1_swedish_ci OK
colors 101 MyISAM latin1_swedish_ci OK
data_input 13 MyISAM latin1_swedish_ci OK
data_input_data 24801 MyISAM latin1_swedish_ci OK
data_input_fields 55 MyISAM latin1_swedish_ci OK
data_local 2104 MyISAM latin1_swedish_ci OK
data_template 53 MyISAM latin1_swedish_ci OK
data_template_data 2157 MyISAM latin1_swedish_ci OK
data_template_data_rra 9721 MyISAM latin1_swedish_ci OK
data_template_rrd 4486 MyISAM latin1_swedish_ci OK
graph_local 1476 MyISAM latin1_swedish_ci OK
graph_template_input 88 MyISAM latin1_swedish_ci OK
graph_template_input_defs 298 MyISAM latin1_swedish_ci OK
graph_templates 38 MyISAM latin1_swedish_ci OK
graph_templates_gprint 3 MyISAM latin1_swedish_ci OK
graph_templates_graph 1514 MyISAM latin1_swedish_ci OK
graph_templates_item 17990 MyISAM latin1_swedish_ci OK
graph_tree 5 MyISAM latin1_swedish_ci OK
graph_tree_items 75 MyISAM latin1_swedish_ci OK
host 311 MyISAM latin1_swedish_ci OK
host_graph 626 MyISAM latin1_swedish_ci OK
host_snmp_cache 469801 MyISAM latin1_swedish_ci OK
host_snmp_query 313 MyISAM latin1_swedish_ci OK
host_template 8 MyISAM latin1_swedish_ci OK
host_template_graph 17 MyISAM latin1_swedish_ci OK
host_template_snmp_query 14 MyISAM latin1_swedish_ci OK
plugin_aggregate_color_template_items 44 MyISAM latin1_swedish_ci OK
plugin_aggregate_color_templates 4 MyISAM latin1_swedish_ci OK
plugin_config 5 MyISAM latin1_swedish_ci OK
plugin_db_changes 2418 MyISAM latin1_swedish_ci OK
plugin_discover_hosts 227 MyISAM latin1_swedish_ci OK
plugin_discover_template 1 MyISAM latin1_swedish_ci OK
plugin_hooks 55 MyISAM latin1_swedish_ci OK
plugin_realms 10 MyISAM latin1_swedish_ci OK
plugin_thold_contacts 8 MyISAM latin1_swedish_ci OK
plugin_thold_log 0 MyISAM latin1_swedish_ci OK
plugin_thold_template_contact 0 MyISAM latin1_swedish_ci OK
plugin_thold_threshold_contact 0 MyISAM latin1_swedish_ci OK
plugin_update_info 7 MyISAM latin1_swedish_ci OK
poller 0 MyISAM latin1_swedish_ci OK
poller_command 0 MyISAM latin1_swedish_ci OK
poller_item 4317 MyISAM latin1_swedish_ci OK
poller_output 0 MyISAM latin1_swedish_ci OK
poller_reindex 313 MyISAM latin1_swedish_ci OK
poller_time 5 MyISAM latin1_swedish_ci OK
rra 5 MyISAM latin1_swedish_ci OK
rra_cf 10 MyISAM latin1_swedish_ci OK
settings 88 MyISAM latin1_swedish_ci OK
settings_graphs 35 MyISAM latin1_swedish_ci OK
settings_tree 0 MyISAM latin1_swedish_ci OK
snmp_query 8 MyISAM latin1_swedish_ci OK
snmp_query_graph 19 MyISAM latin1_swedish_ci OK
snmp_query_graph_rrd 39 MyISAM latin1_swedish_ci OK
snmp_query_graph_rrd_sv 59 MyISAM latin1_swedish_ci OK
snmp_query_graph_sv 40 MyISAM latin1_swedish_ci OK
thold_data 0 MyISAM latin1_swedish_ci OK
thold_template 0 MyISAM latin1_swedish_ci OK
user_auth 9 MyISAM latin1_swedish_ci OK
user_auth_perms 0 MyISAM latin1_swedish_ci OK
user_auth_realm 225 MyISAM latin1_swedish_ci OK
user_log 82 MyISAM latin1_swedish_ci OK
version 1 MyISAM latin1_swedish_ci OK
weathermap_auth 4 MyISAM latin1_swedish_ci OK
weathermap_data 0 MyISAM latin1_swedish_ci OK
weathermap_maps 2 MyISAM latin1_swedish_ci OK
weathermap_settings 0 MyISAM latin1_swedish_ci OK
PHP Module Information
apache2handler
Apache Version Apache/2.2.11 (Win32) PHP/5.2.9-2
Apache API Version 20051115
Server Administrator admin[at]localhost
Hostname:Port 10.22.172.7:0
Max Requests Per Child: 0 - Keep Alive: on - Max Per Connection: 100
Timeouts Connection: 300 - Keep-Alive: 5
Virtual Server No
Server Root G:/Apache2
Loaded Modules core mod_win32 mpm_winnt http_core mod_so mod_actions mod_alias mod_asis mod_auth_basic mod_authn_default mod_authn_file mod_authz_default mod_authz_groupfile mod_authz_host mod_authz_user mod_autoindex mod_cgi mod_dir mod_env mod_include mod_isapi mod_log_config mod_mime mod_negotiation mod_setenvif mod_php5

Directive Local Value Master Value
engine 1 1
last_modified 0 0
xbithack 0 0

Apache Environment
Variable Value
HTTP_HOST 10.22.172.7
HTTP_USER_AGENT Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.5; en-US; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3
HTTP_ACCEPT text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
HTTP_ACCEPT_LANGUAGE en-us,en;q=0.5
HTTP_ACCEPT_ENCODING gzip,deflate
HTTP_ACCEPT_CHARSET ISO-8859-1,utf-8;q=0.7,*;q=0.7
HTTP_KEEP_ALIVE 300
HTTP_CONNECTION keep-alive
HTTP_REFERER http://10.22.172.7/cacti/utilities.php
HTTP_COOKIE Cacti=ndhhj79aaks0620tirddntfs95
PATH G:\php\;G:\CSCOpx\objects\smarts\lib;G:\CSCOpx\objects\smarts\bin;G:\CSCOpx\campus\bin;G:\CSCOpx\MDC\tomcat\bin;G:\CSCOpx\MDC\Apache;G:\CSCOpx\MDC\jre\bin;G:\CSCOpx\MDC\bin;G:\CSCOpx\lib\jre\bin\server;G:\CSCOpx\objects\db\win32;G:\CSCOpx\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;G:\CSCOpx\objects\wfengine\Program\procsys;G:\net-snmp\bin;G:\MySQL\bin
SystemRoot C:\WINDOWS
COMSPEC C:\WINDOWS\system32\cmd.exe
PATHEXT .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH
WINDIR C:\WINDOWS
SERVER_SIGNATURE no value
SERVER_SOFTWARE Apache/2.2.11 (Win32) PHP/5.2.9-2
SERVER_NAME 10.22.172.7
SERVER_ADDR 10.22.172.7
SERVER_PORT 80
REMOTE_ADDR 10.22.146.100
DOCUMENT_ROOT G:/Apache2/htdocs
SERVER_ADMIN admin[at]localhost
SCRIPT_FILENAME G:/Apache2/htdocs/cacti/utilities.php
REMOTE_PORT 53107
GATEWAY_INTERFACE CGI/1.1
SERVER_PROTOCOL HTTP/1.1
REQUEST_METHOD GET
QUERY_STRING action=view_tech
REQUEST_URI /cacti/utilities.php?action=view_tech
SCRIPT_NAME /cacti/utilities.php

HTTP Headers Information
HTTP Request Headers
HTTP Request GET /cacti/utilities.php?action=view_tech HTTP/1.1
Host 10.22.172.7
User-Agent Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.5; en-US; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3
Accept text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language en-us,en;q=0.5
Accept-Encoding gzip,deflate
Accept-Charset ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive 300
Connection keep-alive
Referer http://10.22.172.7/cacti/utilities.php
Cookie Cacti=ndhhj79aaks0620tirddntfs95
HTTP Response Headers
X-Powered-By PHP/5.2.9-2
Expires Thu, 19 Nov 1981 08:52:00 GMT
Last-Modified Mon, 28 Sep 2009 19:06:34 GMT
Cache-Control no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma no-cache
P3P CP="CAO PSA OUR"

bcmath
BCMath support enabled

calendar
Calendar support enabled

com_dotnet
COM support enabled
DCOM support disabled
.Net support enabled

Directive Local Value Master Value
com.allow_dcom 0 0
com.autoregister_casesensitive 1 1
com.autoregister_typelib 0 0
com.autoregister_verbose 0 0
com.code_page no value no value
com.typelib_file no value no value

ctype
ctype functions enabled

date
date/time support enabled
"Olson" Timezone Database Version 2009.1
Timezone Database internal
Default timezone America/Chicago

Directive Local Value Master Value
date.default_latitude 31.7667 31.7667
date.default_longitude 35.2333 35.2333
date.sunrise_zenith 90.583333 90.583333
date.sunset_zenith 90.583333 90.583333
date.timezone no value no value

dom
DOM/XML enabled
DOM/XML API Version 20031129
libxml Version 2.7.3
HTML Support enabled
XPath Support enabled
XPointer Support enabled
Schema Support enabled
RelaxNG Support enabled

filter
Input Validation and Filtering enabled
Revision $Revision: 1.52.2.45 $

Directive Local Value Master Value
filter.default unsafe_raw unsafe_raw
filter.default_flags no value no value

ftp
FTP support enabled

gd
GD Support enabled
GD Version bundled (2.0.34 compatible)
FreeType Support enabled
FreeType Linkage with freetype
FreeType Version 2.1.9
T1Lib Support enabled
GIF Read Support enabled
GIF Create Support enabled
JPG Support enabled
PNG Support enabled
WBMP Support enabled
XBM Support enabled

hash
hash support enabled
Hashing Engines md2 md4 md5 sha1 sha256 sha384 sha512 ripemd128 ripemd160 ripemd256 ripemd320 whirlpool tiger128,3 tiger160,3 tiger192,3 tiger128,4 tiger160,4 tiger192,4 snefru gost adler32 crc32 crc32b haval128,3 haval160,3 haval192,3 haval224,3 haval256,3 haval128,4 haval160,4 haval192,4 haval224,4 haval256,4 haval128,5 haval160,5 haval192,5 haval224,5 haval256,5

iconv
iconv support enabled
iconv implementation "libiconv"
iconv library version 1.11

Directive Local Value Master Value
iconv.input_encoding ISO-8859-1 ISO-8859-1
iconv.internal_encoding ISO-8859-1 ISO-8859-1
iconv.output_encoding ISO-8859-1 ISO-8859-1

json
json support enabled
json version 1.2.1

ldap
LDAP Support enabled
RCS Version $Id: ldap.c,v 1.161.2.3.2.14 2008/12/31 11:17:39 sebastian Exp $
Total Links 0/unlimited
API Version 2004
Vendor Name OpenLDAP
Vendor Version 0

libxml
libXML support active
libXML Version 2.7.3
libXML streams enabled

mysql
MySQL Support enabled
Active Persistent Links 1
Active Links 1
Client API version 5.0.51a

Directive Local Value Master Value
mysql.allow_persistent On On
mysql.connect_timeout 60 60
mysql.default_host no value no value
mysql.default_password no value no value
mysql.default_port no value no value
mysql.default_socket no value no value
mysql.default_user no value no value
mysql.max_links Unlimited Unlimited
mysql.max_persistent Unlimited Unlimited
mysql.trace_mode Off Off

odbc
ODBC Support enabled
Active Persistent Links 0
Active Links 0
ODBC library Win32

Directive Local Value Master Value
odbc.allow_persistent On On
odbc.check_persistent On On
odbc.default_cursortype Static cursor Static cursor
odbc.default_db no value no value
odbc.default_pw no value no value
odbc.default_user no value no value
odbc.defaultbinmode return as is return as is
odbc.defaultlrl return up to 4096 bytes return up to 4096 bytes
odbc.max_links Unlimited Unlimited
odbc.max_persistent Unlimited Unlimited

pcre
PCRE (Perl Compatible Regular Expressions) Support enabled
PCRE Library Version 7.8 2008-09-05

Directive Local Value Master Value
pcre.backtrack_limit 100000 100000
pcre.recursion_limit 100000 100000

Reflection
Reflection enabled
Version $Id: php_reflection.c,v 1.164.2.33.2.55 2008/12/31 11:17:42 sebastian Exp $

session
Session Support enabled
Registered save handlers files user
Registered serializer handlers php php_binary wddx

Directive Local Value Master Value
session.auto_start Off Off
session.bug_compat_42 Off Off
session.bug_compat_warn On On
session.cache_expire 180 180
session.cache_limiter nocache nocache
session.cookie_domain no value no value
session.cookie_httponly Off Off
session.cookie_lifetime 0 0
session.cookie_path / /
session.cookie_secure Off Off
session.entropy_file no value no value
session.entropy_length 0 0
session.gc_divisor 1000 1000
session.gc_maxlifetime 1440 1440
session.gc_probability 1 1
session.hash_bits_per_character 5 5
session.hash_function 0 0
session.name Cacti PHPSESSID
session.referer_check no value no value
session.save_handler files files
session.save_path G:\php\sessiondata G:\php\sessiondata
session.serialize_handler php php
session.use_cookies On On
session.use_only_cookies Off Off
session.use_trans_sid 0 0

SimpleXML
Simplexml support enabled
Revision $Revision: 1.151.2.22.2.46 $
Schema support enabled

snmp
UCD-SNMP Support enabled
UCD-SNMP Version ucd-snmp-4.2.3

SPL
SPL support enabled
Interfaces Countable, OuterIterator, RecursiveIterator, SeekableIterator, SplObserver, SplSubject
Classes AppendIterator, ArrayIterator, ArrayObject, BadFunctionCallException, BadMethodCallException, CachingIterator, DirectoryIterator, DomainException, EmptyIterator, FilterIterator, InfiniteIterator, InvalidArgumentException, IteratorIterator, LengthException, LimitIterator, LogicException, NoRewindIterator, OutOfBoundsException, OutOfRangeException, OverflowException, ParentIterator, RangeException, RecursiveArrayIterator, RecursiveCachingIterator, RecursiveDirectoryIterator, RecursiveFilterIterator, RecursiveIteratorIterator, RecursiveRegexIterator, RegexIterator, RuntimeException, SimpleXMLIterator, SplFileInfo, SplFileObject, SplObjectStorage, SplTempFileObject, UnderflowException, UnexpectedValueException

standard
Regex Library Bundled library enabled
Dynamic Library Support enabled
Internal Sendmail Support for Windows enabled

Directive Local Value Master Value
assert.active 1 1
assert.bail 0 0
assert.callback no value no value
assert.quiet_eval 0 0
assert.warning 1 1
auto_detect_line_endings 0 0
default_socket_timeout 60 60
safe_mode_allowed_env_vars PHP_ PHP_
safe_mode_protected_env_vars LD_LIBRARY_PATH LD_LIBRARY_PATH
url_rewriter.tags a=href,area=href,frame=src,input=src,form=fakeentry a=href,area=href,frame=src,input=src,form=fakeentry
user_agent no value no value

tokenizer
Tokenizer Support enabled

wddx
WDDX Support enabled
WDDX Session Serializer enabled

xml
XML Support active
XML Namespace Support active
libxml2 Version 2.7.3

xmlreader
XMLReader enabled

xmlwriter
XMLWriter enabled

zlib
ZLib Support enabled
Stream Wrapper support compress.zlib://
Stream Filter support zlib.inflate, zlib.deflate
Compiled Version 1.2.3
Linked Version 1.2.3

Directive Local Value Master Value
zlib.output_compression Off Off
zlib.output_compression_level -1 -1
zlib.output_handler no value no value

Additional Modules
Module Name

[BSOD2600]

The only obvious error I saw was: 09/28/2009 10:12:09 AM - SPINE: Poller[0] Host[13] DS[411] SNMP: v2: 170.206.105.225, dsname: errors_out, oid: .1.3.6.1.2.1.2.2.1.20.123, value: U

Manually snmpwalk 1.3.6.1.2.1.2.2.1.20 against Host[13] -- does it return any data? if not, then it doesn't support that errors_out query. If it does, note what index it's using and report back.

[bhoskins]

I BSOD, thanks for taking the time to review my post. I did walk that tree, and did get back valid values for all the interfaces. Not sure exactly what the deal was there.

snmpwalk....
<snip>
IF-MIB::ifOutErrors.110 = Counter32: 0
IF-MIB::ifOutErrors.111 = Counter32: 21
IF-MIB::ifOutErrors.116 = Counter32: 0
IF-MIB::ifOutErrors.117 = Counter32: 0
<snip>

I probably should have been a little more specific in my original post. I'm particularly concerned about the defaults for Cisco hosts and SNMP Interface utilization. I do plot errors for may devices and that has always worked very well. In fact, recently when cacti's accuracy came into question at my office, a little expect script run over a few days gathering CLI discard data successfully corroborated cacti's data.

I've attached a graph of interface utilization that can explain in 28kB what i couldn't in 2000 words. Also, some other things that might be worth noting.

1. Cacti is relatively new to this network. Due to some hardware problems, after about a week of polling, where i was fighting this same issue, I had to start again from scratch with a new server, database, install, the whole 9 yards...

2. Out of about 600 graphs on this cacti install using this template, it happens to probably only ~10% of them.

3. All above references to graphs are Cisco Catalyst ATM interface utilization. I graph utilization for both the physical and PVC interface levels. This happens only to the PVCs.

4. There is no correlation to Cisco code version. I wish there were.

Thanks,

bhoskins

[BSOD2600]

1) that snmpwalk doesn't have an index for 123, as Host[13] DS[411] is trying to poll. Did you omit it or there is no data? Anyways, seems this is a minor issue in the scope of things.

2) That graph at first glace, looks like it's been chopped/limited in the Y-axis. Turn on graph debugging and paste the output ... or look at the graph template and see if a maximum has been set. Edit: hmm, that graph actually looks like the traffic graph, yet modified?

3) If the graph template is fine, then next is the Data Template for interface errors. It's possible the max for the errors_out DS is set too small. run rrdtool info for whatever file DS[411] points to and paste the output.

4) It wouldn't hurt to read over http://forums.cacti.net/viewtopic.php?t=24526