SPINE Problem with Interface - Traffic
Moderators: Developers, Moderators
SPINE Problem with Interface - Traffic
Hello,
I am not sure where to go with this, am seeking advice on where to look next. The solution is probably really simple.
I am wanting to switch poller processes from cmd.php to spine, due to the number of devices / rrd's I am working with (~2 minutes currently for cmd.php, expecting this to grow significantly in the near future). I compiled the svn 5/31/08 version of spine for my cacti 0.8.7b. I had no previous version of spine. When I change from cmd.php to spine, the polling process time was reduced to ~35 seconds, however there were a large number of "WARNING: Result from SNMP not valid. Partial Result: ..." messages. While looking at this, the problem appears to be with "Interface - Traffic". It almost seems like spine is unable to query my devices specifically for interface traffic data. Everything else appears to poll and graphs correctly, I just get no data on my interfaces (any device interface; router / computer / switch / et cetera).
I checked my data templates Interface - Traffic for duplicate traffic_in / traffic_out, no luck.
I have made no special modifications to Cacti. It's all base software with plugin arch and a few plugins.
Any suggestions on what or where to look now?
Switching back to cmd.php, everything appears normal again.
Thanks,
Dark
I am not sure where to go with this, am seeking advice on where to look next. The solution is probably really simple.
I am wanting to switch poller processes from cmd.php to spine, due to the number of devices / rrd's I am working with (~2 minutes currently for cmd.php, expecting this to grow significantly in the near future). I compiled the svn 5/31/08 version of spine for my cacti 0.8.7b. I had no previous version of spine. When I change from cmd.php to spine, the polling process time was reduced to ~35 seconds, however there were a large number of "WARNING: Result from SNMP not valid. Partial Result: ..." messages. While looking at this, the problem appears to be with "Interface - Traffic". It almost seems like spine is unable to query my devices specifically for interface traffic data. Everything else appears to poll and graphs correctly, I just get no data on my interfaces (any device interface; router / computer / switch / et cetera).
I checked my data templates Interface - Traffic for duplicate traffic_in / traffic_out, no luck.
I have made no special modifications to Cacti. It's all base software with plugin arch and a few plugins.
Any suggestions on what or where to look now?
Switching back to cmd.php, everything appears normal again.
Thanks,
Dark
- rony
- Developer/Forum Admin
- Posts: 6022
- Joined: Mon Nov 17, 2003 6:35 pm
- Location: Michigan, USA
- Contact:
Um...
What version of NET-SNMP libs and headers do you have installed?
What version of NET-SNMP libs and headers do you have installed?
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
rony wrote:Um...
What version of NET-SNMP libs and headers do you have installed?
NET-SNMP version: 5.3.1
I'm tempted to gather and post full spec's on the environment, but I'm afraid of information overload; post too much data and it would require too much effort to troubleshoot. I don't think the problem is with the common Cacti environment, but instead something stupid I continue to overlook.
Any thoughts are appreciated.
A little more data
Trying to keep information relevant.
This is debug logging for a single host and subsequent snmpwalk for the OIDs in question;
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4774] SNMP: v2: 10.200.6.100, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.2, value: U
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4774] WARNING: Result from SNMP not valid. Partial Result: ...
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4774] SNMP: v2: 10.200.6.100, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.2, value: U
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4774] WARNING: Result from SNMP not valid. Partial Result: ...
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4773] SNMP: v2: 10.200.6.100, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.1, value: U
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4773] WARNING: Result from SNMP not valid. Partial Result: ...
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4773] SNMP: v2: 10.200.6.100, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.1, value: U
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4773] WARNING: Result from SNMP not valid. Partial Result: ...
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4772] SCRIPT: perl /var/www/cacti/scripts/unix_processes.pl, output: 79
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DEBUG: The POPEN returned the following File Descriptor 12
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4771] SCRIPT: perl /var/www/cacti/scripts/ping.pl 10.200.6.100, output: 2.95
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DEBUG: The POPEN returned the following File Descriptor 12
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4770] SCRIPT: perl /var/www/cacti/scripts/unix_users.pl , output: 1
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DEBUG: The POPEN returned the following File Descriptor 12
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4769] SCRIPT: perl /var/www/cacti/scripts/loadavg_multi.pl, output: 1min:0.81 5min:0.87 10min:1.10
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DEBUG: The POPEN returned the following File Descriptor 12
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_step-300 WHERE rrd_next_step < 0 and host_id=490'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_next_step-300 WHERE host_id=490'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context FROM poller_item WHERE host_id=490 and rrd_next_step <=0 ORDER by snmp_port'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT snmp_port, count(snmp_port) FROM poller_item WHERE host_id=490 AND rrd_next_step < 0 GROUP BY snmp_port'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_reindex SET assert_value='20934300' WHERE host_id='490' AND data_query_id='1' and arg1='.1.3.6.1.2.1.1.3.0''
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] RECACHE: Processing 1 items in the auto reindex cache for '10.200.6.100'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT data_query_id, action, op, assert_value, arg1 FROM poller_reindex WHERE host_id=490'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE host SET status='3', status_event_count='0', status_fail_date='0000-00-00 00:00:00', status_rec_date='0000-00-00 00:00:00', status_last_error='', min_time='1.254560', max_time='477.330000', cur_time='6.284000', avg_time='68.106023', total_polls='692', failed_polls='0', availability='100.0000' WHERE id='490''
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] SNMP Result: Host responded to SNMP
user@cacti:/$ snmpwalk -v2c -c something 10.200.6.100 .1.3.6.1.2.1.2.2.1.16.1
IF-MIB::ifOutOctets.1 = Counter32: 2493977523
user@cacti:/$ snmpwalk -v2c -c something 10.200.6.100 .1.3.6.1.2.1.2.2.1.16.2
IF-MIB::ifOutOctets.2 = Counter32: 726948090
user@cacti:/$ snmpwalk -v2c -c something 10.200.6.100 .1.3.6.1.2.1.2.2.1.10.1
IF-MIB::ifInOctets.1 = Counter32: 725850256
user@cacti:/$ snmpwalk -v2c -c something 10.200.6.100 .1.3.6.1.2.1.2.2.1.10.2
IF-MIB::ifInOctets.2 = Counter32: 2495857744
The "WARNING: Result from SNMP not valid. Partial Result: ..." occurs with every host I am polling "Interface - Traffic" for, which is every host I have in Cacti.
Again, any thoughts or suggestions are appreciated, especially any suggestions on other areas to debug or log.
Thanks,
Dark
This is debug logging for a single host and subsequent snmpwalk for the OIDs in question;
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4774] SNMP: v2: 10.200.6.100, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.2, value: U
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4774] WARNING: Result from SNMP not valid. Partial Result: ...
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4774] SNMP: v2: 10.200.6.100, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.2, value: U
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4774] WARNING: Result from SNMP not valid. Partial Result: ...
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4773] SNMP: v2: 10.200.6.100, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.1, value: U
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4773] WARNING: Result from SNMP not valid. Partial Result: ...
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4773] SNMP: v2: 10.200.6.100, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.1, value: U
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4773] WARNING: Result from SNMP not valid. Partial Result: ...
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4772] SCRIPT: perl /var/www/cacti/scripts/unix_processes.pl, output: 79
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DEBUG: The POPEN returned the following File Descriptor 12
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4771] SCRIPT: perl /var/www/cacti/scripts/ping.pl 10.200.6.100, output: 2.95
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DEBUG: The POPEN returned the following File Descriptor 12
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4770] SCRIPT: perl /var/www/cacti/scripts/unix_users.pl , output: 1
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DEBUG: The POPEN returned the following File Descriptor 12
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DS[4769] SCRIPT: perl /var/www/cacti/scripts/loadavg_multi.pl, output: 1min:0.81 5min:0.87 10min:1.10
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] DEBUG: The POPEN returned the following File Descriptor 12
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_step-300 WHERE rrd_next_step < 0 and host_id=490'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_next_step-300 WHERE host_id=490'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context FROM poller_item WHERE host_id=490 and rrd_next_step <=0 ORDER by snmp_port'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT snmp_port, count(snmp_port) FROM poller_item WHERE host_id=490 AND rrd_next_step < 0 GROUP BY snmp_port'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_reindex SET assert_value='20934300' WHERE host_id='490' AND data_query_id='1' and arg1='.1.3.6.1.2.1.1.3.0''
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] RECACHE: Processing 1 items in the auto reindex cache for '10.200.6.100'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT data_query_id, action, op, assert_value, arg1 FROM poller_reindex WHERE host_id=490'
06/02/2008 09:20:36 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE host SET status='3', status_event_count='0', status_fail_date='0000-00-00 00:00:00', status_rec_date='0000-00-00 00:00:00', status_last_error='', min_time='1.254560', max_time='477.330000', cur_time='6.284000', avg_time='68.106023', total_polls='692', failed_polls='0', availability='100.0000' WHERE id='490''
06/02/2008 09:20:36 PM - SPINE: Poller[0] Host[490] SNMP Result: Host responded to SNMP
user@cacti:/$ snmpwalk -v2c -c something 10.200.6.100 .1.3.6.1.2.1.2.2.1.16.1
IF-MIB::ifOutOctets.1 = Counter32: 2493977523
user@cacti:/$ snmpwalk -v2c -c something 10.200.6.100 .1.3.6.1.2.1.2.2.1.16.2
IF-MIB::ifOutOctets.2 = Counter32: 726948090
user@cacti:/$ snmpwalk -v2c -c something 10.200.6.100 .1.3.6.1.2.1.2.2.1.10.1
IF-MIB::ifInOctets.1 = Counter32: 725850256
user@cacti:/$ snmpwalk -v2c -c something 10.200.6.100 .1.3.6.1.2.1.2.2.1.10.2
IF-MIB::ifInOctets.2 = Counter32: 2495857744
The "WARNING: Result from SNMP not valid. Partial Result: ..." occurs with every host I am polling "Interface - Traffic" for, which is every host I have in Cacti.
Again, any thoughts or suggestions are appreciated, especially any suggestions on other areas to debug or log.
Thanks,
Dark
I am also hitting the same issue.
I am running on RHEL 5.1, Net-SNMP 5.3.1. Spine is compiled from todays SVN sources (I was hitting this bug and it would just crash http://bugs.cacti.net/view.php?id=1183).
Switching to cmd.php restores the graphs.
I did packet captures and the results returned when doing a manual snmpget and a get that is done by spine are the same. For some spine does not want to accept them.
I am running on RHEL 5.1, Net-SNMP 5.3.1. Spine is compiled from todays SVN sources (I was hitting this bug and it would just crash http://bugs.cacti.net/view.php?id=1183).
Switching to cmd.php restores the graphs.
I did packet captures and the results returned when doing a manual snmpget and a get that is done by spine are the same. For some spine does not want to accept them.
-
- Posts: 6
- Joined: Tue Aug 12, 2008 5:07 pm
- Contact:
Me too.
If I swap to cmd.php, the graph can be updated. but if install the spine and swap to it. then no updated graphs anymore..
Here are the details
08/27/2008 10:37:33 AM - SPINE: Poller[0] Host[15] DS[990] WARNING: Result from SNMP not valid. Partial Result: ...
When I ran debug mode. I got this message:
08/27/2008 10:48:10 AM - SPINE: Poller[0] Host[15] DS[989] SNMP: v2: 10.254.25.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.181, value: U
Currently:
Cacti Version 0.8.7b
Interval 300
Type spine
Items Action[0]: 2162
Action[1]: 7
Total: 2169
Concurrent Processes 1
Max Threads 1
PHP Servers 1
Script Timeout 25
Max OID 10
Last Run Statistics Time:7.5508 Method:spine Processes:1 Threads:1 Hosts:17 HostsPerProcess:17 DataSources:2169 RRDsProcessed:1113
If I swap to cmd.php, the graph can be updated. but if install the spine and swap to it. then no updated graphs anymore..
Here are the details
08/27/2008 10:37:33 AM - SPINE: Poller[0] Host[15] DS[990] WARNING: Result from SNMP not valid. Partial Result: ...
When I ran debug mode. I got this message:
08/27/2008 10:48:10 AM - SPINE: Poller[0] Host[15] DS[989] SNMP: v2: 10.254.25.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.181, value: U
Currently:
Cacti Version 0.8.7b
Interval 300
Type spine
Items Action[0]: 2162
Action[1]: 7
Total: 2169
Concurrent Processes 1
Max Threads 1
PHP Servers 1
Script Timeout 25
Max OID 10
Last Run Statistics Time:7.5508 Method:spine Processes:1 Threads:1 Hosts:17 HostsPerProcess:17 DataSources:2169 RRDsProcessed:1113
What does the Value: U mean?08/27/2008 10:48:10 AM - SPINE: Poller[0] Host[15] DS[989] SNMP: v2: 10.254.25.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.181, value: U
I'm also working on a migration for a little 32 bit box to a beefy 64bit box and with the latest svn spine I also am running into what seems like my graphs are not updating. All values are either U or 0.
Code: Select all
09/04/2008 02:45:16 PM - SPINE: Poller[0] Host[452] DS[16474] SNMP: v1: 10.11.19.252, dsname: nsIfSessDrop, oid: .1.3.6.1.4.1.3224.3.2.1.29.10, value: U
Who is online
Users browsing this forum: No registered users and 3 guests