Graphs stopped generating all of a sudden

[kaiserbeto]

Ok ...

Cacti has been running perfectly for a month on my monitoring server, and then all of a sudden all the graphs just stopped generating. No configuration changes have been made to anything like mysql, php, http.

- log file was over 2 GB, but i deleted it
- poller is running every 5 minutes in cron
- there are NO NaN's in the graphs. It shows the data, just not being graphed.
- php.ini memory limits have been increased substantially as has time limits
- there is nothing in error log to indicate any problems or issues
- snmpd is running on server and hosts
- no errors in debug mode. Brings up the graph, just no data.
- currently have over 50% free space on the partition it uses to store data

I can't think of anything else that would cause this. Thoughts, suggestions ... sarcastic remarks ?

[gandalf]

Please post a screenshot of a grpah, then click the graph and the little wrench. Find the "rrdtool graph" statement and post this as well
Reinhard

[kaiserbeto]

Ok,

I was able to fix this way back by truncating the table poller_output.

Now this is happening again; same conditions as above apply, except the log is being rotated after it hits 1 GB so it did not exceed the file system size limit. I've rebuilt the poller cache, truncated the table, and still nothing. No NaN's in graphs, it's just not graphing.

I am, however, getting these errors in the log:

02/28/2007 05:51:08 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select snmp_query_graph_rrd.snmp_field_name, data_template_rrd.id as data_template_rrd_id from (snmp_query_graph_rrd,data_template_rrd) where snmp_query_graph_rrd.data_template_rrd_id=data_template_rrd.local_data_template_rrd_id and snmp_query_graph_rrd.snmp_query_graph_id= and snmp_query_graph_rrd.data_template_id=41 and data_template_rrd.local_data_id=84"

rrdtool graph statement as follows:

> Tree Mode -> ****.******.com- Used Space - / -> Properties Logged in as some_user (Logout)


/usr/bin/rrdtool graph - \
--imgformat=PNG \
--start=-604800 \
--end=-1800 \
--title="****.******.com - Used Space - /" \
--rigid \
--base=1024 \
--height=120 \
--width=500 \
--alt-autoscale-max \
--lower-limit=0 \
--vertical-label="bytes" \
--slope-mode \
DEF:a="/var/www/********/*******.com/****/cacti/rra/****_****_****_hdd_total_136.rrd":hdd_total:AVERAGE \
DEF:b="/var/www/********/*******.com/****/cacti/rra/****_****_****_hdd_total_136.rrd":hdd_used:AVERAGE \
AREA:a#002A97:"Total" \
GPRINTLAST:"Current\:%8.2lf %s" \
GPRINTAVERAGE:"Average\:%8.2lf %s" \
GPRINTMAX:"Maximum\:%8.2lf %s\n" \
AREA:b#F51D30:"Used" \
GPRINTLAST:" Current\:%8.2lf %s" \
GPRINTAVERAGE:"Average\:%8.2lf %s" \
GPRINTMAX:"Maximum\:%8.2lf %s\n"

[gandalf]

Yes, it does not show the string "NaN", because there's still valid data shown for some dates. But it IS the NAN problem, for sure! Please see second link of my signature
Reinhard