Upgrade to 0.8.7b - NANs and strange graphing experience

[mannyz]

Hi guys,
I've just upgraded to from 0.8.6g to 0.8.7b. All seemed fine but I can't just get why all my graphs suddenly started to have - I would say - a strange graphing experience. I have started noticing breaks in all the graphs, outbout traffic graphs is not really clear anymore.

I had a look int cacti.log and I've found those errors:

04/07/2008 09:48:59 AM - CMDPHP: Poller[0] Host[210] DS[2889] WARNING: Result from SNMP not valid. Partial Result:
04/07/2008 09:49:00 AM - CMDPHP: Poller[0] Host[210] DS[2890] WARNING: Result from SNMP not valid. Partial Result:
04/07/2008 09:49:00 AM - CMDPHP: Poller[0] Host[210] DS[2890] WARNING: Result from SNMP not valid. Partial Result:
04/07/2008 09:49:21 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed!, Error:'1064', SQL:"select thold_data.cdef, thold_data.rra_id, thold_data.data_id, thold_data.lastread, thold_data.oldvalue, data_template_rrd.data_source_name as name, data_template_rrd.data_source_type_id from thold_data LEFT JOIN data_template_rrd on (data_template_rrd.id = thold_data.data_id) WHERE data_template_rrd.data_source_name != '' AND "
04/07/2008 09:49:22 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed!, Error:'1064', SQL:"select thold_data.cdef, thold_data.rra_id, thold_data.data_id, thold_data.lastread, thold_data.oldvalue, data_template_rrd.data_source_name as name, data_template_rrd.data_source_type_id from thold_data LEFT JOIN data_template_rrd on (data_template_rrd.id = thold_data.data_id) WHERE data_template_rrd.data_source_name != '' AND "
04/07/2008 09:49:31 AM - CMDPHP: Poller[0] Host[231] DS[2993] WARNING: Result from SNMP not valid. Partial Result:
04/07/2008 09:49:31 AM - CMDPHP: Poller[0] Host[231] DS[2993] WARNING: Result from SNMP not valid. Partial Result:
04/07/2008 09:49:32 AM - CMDPHP: Poller[0] Host[233] DS[2998] WARNING: Result from SNMP not valid. Partial Result:
04/07/2008 09:49:32 AM - CMDPHP: Poller[0] Host[233] DS[2998] WARNING: Result from SNMP not valid. Partial Result:

04/07/2008 09:52:53 AM - CMDPHP: Poller[0] Host[160] DS[2470] WARNING: Result from SNMP not valid. Partial Result: No Such Instance cur
04/07/2008 09:52:53 AM - CMDPHP: Poller[0] Host[160] DS[2470] WARNING: Result from SNMP not valid. Partial Result: No Such Instance cur
04/07/2008 09:52:54 AM - CMDPHP: Poller[0] Host[160] DS[2472] WARNING: Result from SNMP not valid. Partial Result: No Such Instance cur
04/07/2008 09:52:54 AM - CMDPHP: Poller[0] Host[160] DS[2472] WARNING: Result from SNMP not valid. Partial Result: No Such Instance cur
04/07/2008 09:53:15 AM - CMDPHP: Poller[0] Host[174] DS[2620] WARNING: Result from SNMP not valid. Partial Result: No Such Instance cur
04/07/2008 09:53:16 AM - CMDPHP: Poller[0] Host[174] DS[2620] WARNING: Result from SNMP not valid. Partial Result: No Such Instance cur
04/07/2008 09:53:16 AM - CMDPHP: Poller[0] Host[174] DS[2621] WARNING: Result from SNMP not valid. Partial Result: No Such Instance cur
04/07/2008 09:53:16 AM - CMDPHP: Poller[0] Host[174] DS[2621] WARNING: Result from SNMP not valid. Partial Result: No Such Instance cur

Attached to the email you can find few graphs showing how graphs look like now.

Any idea ?

Thanks
Mannyz

[mannyz]

I've issued the command 'rrdtool fetch mplsixelhr_traffic_out_2838.rrd AVERAGE -r 900 -s -1h' and that's what I got:

timestamp traffic_out traffic_in

1207560000: nan nan
1207560300: nan nan
1207560600: nan nan
1207560900: nan nan
1207561200: nan nan
1207561500: nan nan
1207561800: nan nan
1207562100: nan nan
1207562400: nan nan
1207562700: nan nan
1207563000: nan nan
1207563300: nan nan
1207563600: nan nan
1207563900: nan nan

[mannyz]

I've just found that I'm not able to create other graphs.

That's what I've got from switching on debug:

ERROR: opening '/var/www/html/cacti/rra/mpls-eafr02_traffic_out_3127.rrd': No such file or directory

but rrd seems to have created the file:

Data Source Debug

/usr/bin/rrdtool create \
/var/www/html/cacti/rra/mpls-eafr02_traffic_out_3127.rrd \
--step 300 \
DS:traffic_in:COUNTER:600:0:1000000000 \
DS:traffic_out:COUNTER:600:0:1000000000 \
DS:traffic_in:COUNTER:600:0:1000000000 \
DS:traffic_out:COUNTER:600:0:1000000000 \
RRA:AVERAGE:0.5:1:500 \
RRA:AVERAGE:0.5:1:600 \
RRA:AVERAGE:0.5:6:700 \
RRA:AVERAGE:0.5:24:775 \
RRA:AVERAGE:0.5:288:797 \
RRA:MIN:0.5:1:600 \
RRA:MIN:0.5:6:700 \
RRA:MIN:0.5:24:775 \
RRA:MIN:0.5:288:797 \
RRA:MAX:0.5:1:500 \
RRA:MAX:0.5:1:600 \
RRA:MAX:0.5:6:700 \
RRA:MAX:0.5:24:775 \
RRA:MAX:0.5:288:797 \
RRA:LAST:0.5:1:600 \
RRA:LAST:0.5:6:700 \
RRA:LAST:0.5:24:775 \
RRA:LAST:0.5:288:797 \


Any idea ?

Mannyz

[TheWitness]

This is a problem. Do you have any plugins installed? Have you modified the original distribution of Cacti? How did you install it?

04/07/2008 09:49:22 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed!, Error:'1064', SQL:"select thold_data.cdef, thold_data.rra_id, thold_data.data_id, thold_data.lastread, thold_data.oldvalue, data_template_rrd.data_source_name as name, data_template_rrd.data_source_type_id from thold_data LEFT JOIN data_template_rrd on (data_template_rrd.id = thold_data.data_id) WHERE data_template_rrd.data_source_name != '' AND "

TheWitness

[mannyz]

Hi,
this was an upgrade from 0.8.6 to 0.8.7. The upgade process went smoothly. Along with the upgrade process PA arch aws installed. Settings and Thold are the only plugins I have right now. Point is, thold seems even to trigger fine the usage limit I set.

The only strange things is that at some point all seems falling a part.

Just let me know if you need specif information,

Thanks

Mannyz

[TheWitness]

Before you do anything, disable your plugins and verify the proper operation of the system (aka clean logs). Then enable them one at a time until something breaks.

TheWitness

[mannyz]

Hi I've disabled thold (along with all the others) and I can actually see this error the log files.

Moreover I've dug a little more in the forum and I've actually found many people having the same issue as me.

I'm checking this http://forums.cacti.net/viewtopic.php?t=25991. it seems to be the same.

Cheers,
Mannyz