RRD Files missing, Poller Cache Entry Missing, ...

[philz]

Hi all

I'm trying to use cacti to run a custom script to graph 2 values.

I'm running ubuntu (2.6.32-24 / x64). Since I cannot apply the patches to the installation installed via repository (apt), I uninstalled it and downloaded 0.8.8a from the website.

I've followed the guide where applicable (ubuntu-cacti ran before, but had some problems).
I've added two crontab entries, one for poller.php and one for spine, both run every minute - I think this is not necessary? Anyway..

1) rrd not updated and only some created when running poller.php
I noticed that my rra directory was empty. When I ran the poller.php manually, those files were created but they are not updated (NaN).
So my graphs are all empty.

2) rrd not created when running poller.php
So I've created my data source, graph template, data template but the rrd is not created - neither automatically nor when running poller.php/spine.
The device is up, the graph is Being Graphed - but I have no rrd file.

3) Script is not run by poller
When I run spine via command line, the my custom script is not run. No error in the log file, and it's missing in the poller cache. When rebuilding the cache via webUI and via CLI does not change it.
I even deleted it via phpMyAdmin and re-populated it - the one script from my other (not localhost) device is missing.

I've already reinstalled everything, reset the database clean, ran the poller/spine via root to avoid a permission problem and set the rra directory to 777 - nothing so far helped.

I'm at loss... any help is greatly appreciated.

Thanks

edit: I've now seen about 20 threads where the debugging guide is linked and the question was not resolved. It seems that usually the cause is a unavailable host - which is NOT the case here. I have gone through the debugging guide and it did NOT resolve my issue or help me further.


Spine:

Code: Select all

/usr/sbin/spine -C /etc/cacti/spine.conf --verbosity=5
SPINE: Using spine config file [/etc/cacti/spine.conf]
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The path_php_server variable is /usr/share/cacti/script_server.php
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The path_cactilog variable is /usr/share/cacti/log/cacti.log
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The log_destination variable is 1 (FILE)
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The path_php variable is /usr/bin/php
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The availability_method variable is 0
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The ping_recovery_count variable is 0
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The ping_failure_count variable is 0
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The ping_method variable is 0
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The ping_retries variable is 0
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The ping_timeout variable is 0
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The snmp_retries variable is 3
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The log_perror variable is 1
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The log_pwarn variable is 0
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The boost_redirect variable is 0
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The log_pstats variable is 0
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The threads variable is 5
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The polling interval is the system default
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The number of concurrent processes is 1
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The script timeout is 25
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The number of php script servers to run is 2
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: StartHost='-1', EndHost='-1', TotalPHPScripts='0'
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The PHP Script Server is Not Required
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The Maximum SNMP OID Get Size is 25
06/09/2013 03:57:31 AM - SPINE: Poller[0] Version 0.8.7e starting
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: MySQL is Thread Safe!
06/09/2013 03:57:31 AM - SPINE: Poller[0] SPINE: Initializing Net-SNMP API
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: Issues with SNMP Header Version information, assuming old version of Net-SNMP.
06/09/2013 03:57:31 AM - SPINE: Poller[0] SPINE: Initializing PHP Script Server(s)
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: Initial Value of Active Threads is 0
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
06/09/2013 03:57:31 AM - SPINE: Poller[0] Host[0] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 2
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
06/09/2013 03:57:31 AM - SPINE: Poller[0] Host[2] DEBUG: ICMP Host Alive, Try Count:1, Time:0.6349 ms
06/09/2013 03:57:31 AM - SPINE: Poller[0] Host[2] PING: Result ICMP: Host is Alive
06/09/2013 03:57:31 AM - SPINE: Poller[0] Host[2] Host has no information for recache.
06/09/2013 03:57:31 AM - SPINE: Poller[0] Host[2] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 0
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: Thread Cleanup Complete
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: PHP Script Server Pipes Closed
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: Allocated Variable Memory Freed
06/09/2013 03:57:31 AM - SPINE: Poller[0] DEBUG: MYSQL Free & Close Completed
06/09/2013 03:57:31 AM - SPINE: Poller[0] Time: 0.0514 s, Threads: 5, Hosts: 2

[philz]

Screenshots attached

[enyap]

I had a similar problem after upgrading to Ubuntu server 13.04 and Cacti 0.8.8a with Spine as the poller. It was a clean installation and as I added devices I noticed a couple that were show a status "down", all the rest were updating fine. I knew that these were up as I could ping them from the server and in the devices list they were showing as ICMP ping nn.nn. Tried deleting them and re-adding so they had a different device ID, but still no joy. Looking at the graph debug it said that the rrd file didn't exist.

Finally, I changed the poller from Spine to cmd.php and after the usual delay the devices showed as "UP" and the graphs began to populate. I then changed back to Spine and they went to status "down" and holes appeared in the graphs.

I can live with cmd.php, but would like to move back to Spine due to the performance benefits. It's easy to reproduce, so if someone can tell me what debug info they require, I'm happy to generate it.

[davel]

I have a similar problem. Redhat 2.6.18, cacti 0.8.8a, cmd.php. Ported rrds over from older environment and all working well. However when creating new data sources, no rrd is created. Manually running the data source debug output creates the rrd and data are subsequently loaded. Works but far from ideal and I don't want to leave the system with such a workaround

Please advise what information I should provide to help debug this