spine suddenly stopped updating rrd files

Post support questions that directly relate to Linux/Unix operating systems.

Moderators: Developers, Moderators

Post Reply
kamal06
Posts: 11
Joined: Tue Jun 24, 2008 6:18 am
Contact:
Contact kamal06

spine suddenly stopped updating rrd files

Post by kamal06 »

debian etch
cacti 0.8.7b
spine 0.8.7a
rrdtool 1.2.27-2+b

After a fresh installation of cacti and spine everything worked fine. Then suddenly the graphs weren't updated anymore. In the logs there is no "rrdtool update" command which I think should be there.
It says RRDsProcessed:0.
After hours of searching for the cause of this I upgraded rrdtool to 1.2.27-2+b but it didn't help.
The logs basically don't contain any errors.
As long as I use cmd.php there is no problem.
What could I try/examine to fix this?
Top
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:
Contact gandalf

Post by gandalf »

Was spine compiled on your target host?
What's the contents of poller_output table just after such a crash?
Reinhard
Top
kamal06
Posts: 11
Joined: Tue Jun 24, 2008 6:18 am
Contact:
Contact kamal06

Post by kamal06 »

Hi gandalf,
yes spine was compiled on the same machine, with no additional options, exactly as described in the online documentation.

Here is the result of a manual spine run:

Code: Select all

root@osho1:~# /usr/local/spine/bin/spine -V -f 1 -l 10
SPINE: Using spine config file [/etc/spine.conf]
SPINE: Version 0.8.7b starting
SPINE: Time: 2.1180 s, Threads: 1, Hosts: 3
root@osho1:~#

Code: Select all

mysql> use cacti;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Database changed
mysql> select * from poller_output;
Empty set (0.00 sec)

mysql>
Log immediately after the manual spine run

Code: Select all

root@osho1:~# tail -n50 /..../cacti/log/cacti.log
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: SQL:'SELECT id, hostname, snmp_community, snmp_version, snmp_username, snmp_password, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context, snmp_port, snmp_timeout, max_oids, availability_method, ping_method, ping_port, ping_timeout, ping_retries, status, status_event_count, status_fail_date, status_rec_date, status_last_error, min_time, max_time, cur_time, avg_time, total_polls, failed_polls, availability  FROM host WHERE id=1'
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: UDP Ping return_code was -1, errno was 111, total_time was 43.1538
06/25/2008 08:45:01 AM - SPINE: Poller[0] Host[1] PING: Result UDP: Host is Alive
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: SQL:'UPDATE host SET status='3', status_event_count='0', status_fail_date='2008-06-24 13:39:00', status_rec_date='2008-06-24 13:43:00', status_last_error='UDP: Ping timed out', min_time='0.030990', max_time='0.070000', cur_time='0.043150', avg_time='0.042642', total_polls='248', failed_polls='8', availability='96.7742' WHERE id='1''
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: SQL:'SELECT data_query_id, action, op, assert_value, arg1 FROM poller_reindex WHERE host_id=1'
06/25/2008 08:45:01 AM - SPINE: Poller[0] Host[1] RECACHE: Processing 1 items in the auto reindex cache for '127.0.0.1'
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_reindex SET assert_value='U' WHERE host_id='1' AND data_query_id='6' and arg1='.1.3.6.1.2.1.1.3.0''
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: SQL:'SELECT snmp_port, count(snmp_port) FROM poller_item WHERE host_id=1 AND rrd_next_step < 0 GROUP BY snmp_port'
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: SQL:'SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context  FROM poller_item WHERE host_id=1 and rrd_next_step <=0 ORDER by snmp_port'
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_next_step-300 WHERE host_id=1'
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_step-300 WHERE rrd_next_step < 0 and host_id=1'
06/25/2008 08:45:01 AM - SPINE: Poller[0] Host[1] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 0
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: SQL:'SELECT id, hostname, snmp_community, snmp_version, snmp_username, snmp_password, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context, snmp_port, snmp_timeout, max_oids, availability_method, ping_method, ping_port, ping_timeout, ping_retries, status, status_event_count, status_fail_date, status_rec_date, status_last_error, min_time, max_time, cur_time, avg_time, total_polls, failed_polls, availability  FROM host WHERE id=10'
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: UDP Ping return_code was -1, errno was 111, total_time was 23.1266
06/25/2008 08:45:01 AM - SPINE: Poller[0] Host[10] PING: Result UDP: Host is Alive
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: SQL:'UPDATE host SET status='3', status_event_count='0', status_fail_date='2008-06-24 13:39:00', status_rec_date='2008-06-24 13:43:00', status_last_error='UDP: Ping timed out', min_time='0.015970', max_time='0.070000', cur_time='0.023130', avg_time='0.024713', total_polls='248', failed_polls='8', availability='96.7742' WHERE id='10''
06/25/2008 08:45:01 AM - SPINE: Poller[0] DEBUG: SQL:'SELECT data_query_id, action, op, assert_value, arg1 FROM poller_reindex WHERE host_id=10'
06/25/2008 08:45:01 AM - SPINE: Poller[0] Host[10] RECACHE: Processing 1 items in the auto reindex cache for '127.0.0.1'
06/25/2008 08:45:01 AM - CMDPHP: Poller[0] DEBUG: SQL Exec: "replace into settings (name,value) values ('date',NOW())"
06/25/2008 08:45:01 AM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "select poller_id,end_time from poller_time where poller_id=0"
06/25/2008 08:45:01 AM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "select  poller_output.output,  poller_output.time,  poller_output.local_data_id,  poller_item.rrd_path,  poller_item.rrd_name,  poller_item.rrd_num  from (poller_output,poller_item)  where (poller_output.local_data_id=poller_item.local_data_id and poller_output.rrd_name=poller_item.rrd_name)  LIMIT 50000"
06/25/2008 08:45:02 AM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "select poller_id,end_time from poller_time where poller_id=0"
06/25/2008 08:45:02 AM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "select  poller_output.output,  poller_output.time,  poller_output.local_data_id,  poller_item.rrd_path,  poller_item.rrd_name,  poller_item.rrd_num  from (poller_output,poller_item)  where (poller_output.local_data_id=poller_item.local_data_id and poller_output.rrd_name=poller_item.rrd_name)  LIMIT 50000"
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_reindex SET assert_value='U' WHERE host_id='10' AND data_query_id='6' and arg1='.1.3.6.1.2.1.1.3.0''
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: SQL:'SELECT snmp_port, count(snmp_port) FROM poller_item WHERE host_id=10 AND rrd_next_step < 0 GROUP BY snmp_port'
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: SQL:'SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context  FROM poller_item WHERE host_id=10 and rrd_next_step <=0 ORDER by snmp_port'
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_next_step-300 WHERE host_id=10'
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_step-300 WHERE rrd_next_step < 0 and host_id=10'
06/25/2008 08:45:03 AM - SPINE: Poller[0] Host[10] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 0
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: SQL:'replace into settings (name,value) values ('date',NOW())'
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: SQL:'insert into poller_time (poller_id, start_time, end_time) values (0, NOW(), NOW())'
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: Thread Cleanup Complete
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: PHP Script Server Pipes Closed
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: Allocated Variable Memory Freed
06/25/2008 08:45:03 AM - SPINE: Poller[0] SPINE: Net-SNMP API Shutdown Completed
06/25/2008 08:45:03 AM - SPINE: Poller[0] DEBUG: MYSQL Free & Close Completed
06/25/2008 08:45:03 AM - SPINE: Poller[0] Time: 2.1169 s, Threads: 1, Hosts: 3
06/25/2008 08:45:03 AM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "select poller_id,end_time from poller_time where poller_id=0"
06/25/2008 08:45:03 AM - CMDPHP: Poller[0] DEBUG: SQL Assoc: "select  poller_output.output,  poller_output.time,  poller_output.local_data_id,  poller_item.rrd_path,  poller_item.rrd_name,  poller_item.rrd_num  from (poller_output,poller_item)  where (poller_output.local_data_id=poller_item.local_data_id and poller_output.rrd_name=poller_item.rrd_name)  "
06/25/2008 08:45:03 AM - SYSTEM STATS: Time:2.1577 Method:spine Processes:1 Threads:1 Hosts:3 HostsPerProcess:3 DataSources:26 RRDsProcessed:0
06/25/2008 08:45:03 AM - CMDPHP: Poller[0] DEBUG: SQL Exec: "replace into settings (name,value) values ('stats_poller','Time:2.1577 Method:spine Processes:1 Threads:1 Hosts:3 HostsPerProcess:3 DataSources:26 RRDsProcessed:0')"
06/25/2008 08:45:03 AM - CMDPHP: Poller[0] DEBUG: SQL Cell: "select count(*) from poller_command"
Top
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:
Contact gandalf

Post by gandalf »

This log does not help. Please run against a single host only using --verbosity=5. And please see "System Utilities -> View Poller cache for that host". If there's nothing in it, please run ./cli/rebuild_poller_cache.php
Reinhard
Top
kamal06
Posts: 11
Joined: Tue Jun 24, 2008 6:18 am
Contact:
Contact kamal06

Post by kamal06 »

ok, I reduced the cacti configuration to one single device
with one single graph and one data source.

Code: Select all

root@osho1:/var/www/jamba/cacti# /usr/local/spine/bin/spine -V 5 -f 11 -l 11
SPINE: Using spine config file [/etc/spine.conf]
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'path_webroot''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'path_cactilog''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The path_php_server variable is /var/www/jamba/cacti/script_server.php
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The path_cactilog variable is /var/www/jamba/cacti/log/cacti.log
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'log_destination''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The log_destination variable is 1 (FILE)
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'path_php_binary''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The path_php variable is /usr/bin/php
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'availability_method''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The availability_method variable is 3
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'ping_recovery_count''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The ping_recovery_count variable is 3
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'ping_failure_count''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The ping_failure_count variable is 2
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'ping_method''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The ping_method variable is 2
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'ping_retries''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The ping_retries variable is 1
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'ping_timeout''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The ping_timeout variable is 400
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'log_perror''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The log_perror variable is 1
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'log_pwarn''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The log_pwarn variable is 1
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'log_pstats''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The log_pstats variable is 1
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'max_threads''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The threads variable is 1
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'poller_interval''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The polling interval is 300 seconds
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'concurrent_processes''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The number of concurrent processes is 1
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'script_timeout''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The script timeout is 25
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'php_servers''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The number of php script servers to run is 1
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT action FROM poller_item WHERE action=2 AND host_id BETWEEN 11 AND 11 LIMIT 1'
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: StartHost='11', EndHost='11', TotalPHPScripts='0'
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The PHP Script Server is Not Required
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT value FROM settings WHERE name = 'max_get_size''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The Maximum SNMP OID Get Size is 10
06/25/2008 10:42:01 PM - SPINE: Poller[0] Version 0.8.7b starting
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: MySQL is Thread Safe!
06/25/2008 10:42:01 PM - SPINE: Poller[0] SPINE: Initializing Net-SNMP API
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SNMP Header Version is 5.2.3
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SNMP Library Version is 5.2.3
06/25/2008 10:42:01 PM - SPINE: Poller[0] SPINE: Initializing PHP Script Server(s)
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT id FROM host WHERE disabled='' AND id BETWEEN 11 AND 11 ORDER BY id'
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: Initial Value of Active Threads is 0
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT snmp_port, count(snmp_port) FROM poller_item WHERE host_id=0 AND rrd_next_step < 0 GROUP BY snmp_port'
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context  FROM poller_item WHERE host_id=0 and rrd_next_step <=0 ORDER by snmp_port'
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_next_step-300 WHERE host_id=0'
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_step-300 WHERE rrd_next_step < 0 and host_id=0'
06/25/2008 10:42:01 PM - SPINE: Poller[0] Host[0] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 0
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT id, hostname, snmp_community, snmp_version, snmp_username, snmp_password, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context, snmp_port, snmp_timeout, max_oids, availability_method, ping_method, ping_port, ping_timeout, ping_retries, status, status_event_count, status_fail_date, status_rec_date, status_last_error, min_time, max_time, cur_time, avg_time, total_polls, failed_polls, availability  FROM host WHERE id=11'
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: UDP Ping return_code was -1, errno was 111, total_time was 42.9153
06/25/2008 10:42:01 PM - SPINE: Poller[0] Host[11] PING: Result UDP: Host is Alive
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE host SET status='3', status_event_count='0', status_fail_date='0000-00-00 00:00:00', status_rec_date='0000-00-00 00:00:00', status_last_error='', min_time='0.042920', max_time='0.090000', cur_time='0.042920', avg_time='0.066463', total_polls='4', failed_polls='0', availability='100.0000' WHERE id='11''
06/25/2008 10:42:01 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT data_query_id, action, op, assert_value, arg1 FROM poller_reindex WHERE host_id=11'
06/25/2008 10:42:01 PM - SPINE: Poller[0] Host[11] RECACHE: Processing 1 items in the auto reindex cache for '127.0.0.1'
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_reindex SET assert_value='U' WHERE host_id='11' AND data_query_id='6' and arg1='.1.3.6.1.2.1.1.3.0''
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT snmp_port, count(snmp_port) FROM poller_item WHERE host_id=11 AND rrd_next_step < 0 GROUP BY snmp_port'
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: SQL:'SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context  FROM poller_item WHERE host_id=11 and rrd_next_step <=0 ORDER by snmp_port'
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_next_step-300 WHERE host_id=11'
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: SQL:'UPDATE poller_item SET rrd_next_step=rrd_step-300 WHERE rrd_next_step < 0 and host_id=11'
06/25/2008 10:42:03 PM - SPINE: Poller[0] Host[11] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 0
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: SQL:'replace into settings (name,value) values ('date',NOW())'
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: SQL:'insert into poller_time (poller_id, start_time, end_time) values (0, NOW(), NOW())'
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: Thread Cleanup Complete
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: PHP Script Server Pipes Closed
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: Allocated Variable Memory Freed
06/25/2008 10:42:03 PM - SPINE: Poller[0] SPINE: Net-SNMP API Shutdown Completed
06/25/2008 10:42:03 PM - SPINE: Poller[0] DEBUG: MYSQL Free & Close Completed
06/25/2008 10:42:03 PM - SPINE: Poller[0] Time: 2.2043 s, Threads: 1, Hosts: 2

System Utilities -> View Poller cache shows the correct file but it
is not updated.

Code: Select all

Localhost - Logged in Users   	 
Script: perl /var/www/jamba/cacti/scripts/unix_users.pl
RRD: /var/www/jamba/cacti/rra/users_80.rrd
Top
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:
Contact gandalf

Post by gandalf »

Please run

Code: Select all

SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context  FROM poller_item WHERE host_id=11 and rrd_next_step <=0 ORDER by snmp_port
from mysql command line and post results. This should show all polling entries for your host
Reinhard
Top
kamal06
Posts: 11
Joined: Tue Jun 24, 2008 6:18 am
Contact:
Contact kamal06

Post by kamal06 »

Something interesting happened. Just for testing I changed the single graph from "Logged in Users" to "Load Average" and since then spine is working again!!
I have no idea why and I am not sure if this was the actual cause but it's the only thing I remember what I changed in the configuration.
I switched back to cmd.php which worked as well.

I changed the intervals in cron to one minute also in settings both intervals to one minute. Since then neither cmd.php nor spine is working any more. I switched back to 5 minutes for all three intervals. Now spine ist still working but cmd.php is not. So now it's the other way around! Propably my whole configuration/installation is messed, I will reinstall everything tomorrow.

The output of the query you requested (after the last spine run):

Code: Select all

mysql> SELECT action, hostname, snmp_community, snmp_version, snmp_username, snmp_password, rrd_name, rrd_path, arg1, arg2, arg3, local_data_id, rrd_num, snmp_port, snmp_timeout, snmp_auth_protocol, snmp_priv_passphrase, snmp_priv_protocol, snmp_context  FROM poller_item WHERE host_id=11 and rrd_next_step <=0 ORDER by snmp_port \G
*************************** 1. row ***************************
              action: 1
            hostname: 127.0.0.1
      snmp_community: xyz
        snmp_version: 1
       snmp_username:
       snmp_password:
            rrd_name:
            rrd_path: /var/www/jamba/cacti/rra/localhost_load_1min_87.rrd
                arg1: perl /var/www/jamba/cacti/scripts/loadavg_multi.pl
                arg2:
                arg3:
       local_data_id: 87
             rrd_num: 1
           snmp_port: 161
        snmp_timeout: 500
  snmp_auth_protocol: MD5
snmp_priv_passphrase:
  snmp_priv_protocol: DES
        snmp_context:
*************************** 2. row ***************************
              action: 1
            hostname: 127.0.0.1
      snmp_community: xyz
        snmp_version: 1
       snmp_username:
       snmp_password:
            rrd_name:
            rrd_path: /var/www/jamba/cacti/rra/localhost_load_1min_83.rrd
                arg1: perl /var/www/jamba/cacti/scripts/loadavg_multi.pl
                arg2:
                arg3:
       local_data_id: 83
             rrd_num: 1
           snmp_port: 161
        snmp_timeout: 500
  snmp_auth_protocol: MD5
snmp_priv_passphrase:
  snmp_priv_protocol: DES
        snmp_context:
*************************** 3. row ***************************
              action: 1
            hostname: 127.0.0.1
      snmp_community: xyz
        snmp_version: 1
       snmp_username:
       snmp_password:
            rrd_name: ping
            rrd_path: /var/www/jamba/cacti/rra/localhost_ping_88.rrd
                arg1: perl /var/www/jamba/cacti/scripts/ping.pl 127.0.0.1
                arg2:
                arg3:
       local_data_id: 88
             rrd_num: 1
           snmp_port: 161
        snmp_timeout: 500
  snmp_auth_protocol: MD5
snmp_priv_passphrase:
  snmp_priv_protocol: DES
        snmp_context:
*************************** 4. row ***************************
              action: 1
            hostname: 127.0.0.1
      snmp_community: xyz
        snmp_version: 1
       snmp_username:
       snmp_password:
            rrd_name: users
            rrd_path: /var/www/jamba/cacti/rra/localhost_users_85.rrd
                arg1: perl /var/www/jamba/cacti/scripts/unix_users.pl
                arg2:
                arg3:
       local_data_id: 85
             rrd_num: 1
           snmp_port: 161
        snmp_timeout: 500
  snmp_auth_protocol: MD5
snmp_priv_passphrase:
  snmp_priv_protocol: DES
        snmp_context:
*************************** 5. row ***************************
              action: 1
            hostname: 127.0.0.1
      snmp_community: xyz
        snmp_version: 1
       snmp_username:
       snmp_password:
            rrd_name: ping
            rrd_path: /var/www/jamba/cacti/rra/localhost_ping_89.rrd
                arg1: perl /var/www/jamba/cacti/scripts/ping.pl 127.0.0.1
                arg2:
                arg3:
       local_data_id: 89
             rrd_num: 1
           snmp_port: 161
        snmp_timeout: 500
  snmp_auth_protocol: MD5
snmp_priv_passphrase:
  snmp_priv_protocol: DES
        snmp_context:
*************************** 6. row ***************************
              action: 1
            hostname: 127.0.0.1
      snmp_community: xyz
        snmp_version: 1
       snmp_username:
       snmp_password:
            rrd_name:
            rrd_path: /var/www/jamba/cacti/rra/localhost_load_1min_90.rrd
                arg1: perl /var/www/jamba/cacti/scripts/loadavg_multi.pl
                arg2:
                arg3:
       local_data_id: 90
             rrd_num: 1
           snmp_port: 161
        snmp_timeout: 500
  snmp_auth_protocol: MD5
snmp_priv_passphrase:
  snmp_priv_protocol: DES
        snmp_context:
*************************** 7. row ***************************
              action: 1
            hostname: 127.0.0.1
      snmp_community: xyz
        snmp_version: 1
       snmp_username:
       snmp_password:
            rrd_name: proc
            rrd_path: /var/www/jamba/cacti/rra/localhost_proc_91.rrd
                arg1: perl /var/www/jamba/cacti/scripts/unix_processes.pl
                arg2:
                arg3:
       local_data_id: 91
             rrd_num: 1
           snmp_port: 161
        snmp_timeout: 500
  snmp_auth_protocol: MD5
snmp_priv_passphrase:
  snmp_priv_protocol: DES
        snmp_context:
7 rows in set (0.00 sec)
Top
Post Reply

Return to “Help: Linux/Unix Specific”

Who is online

Users browsing this forum: No registered users and 0 guests