Graphs stopped logging data, new graphs showing NAN values

[l33byt]

HI,

I am hoping some one can assist with an issue I have.
I had an up and running cacti installation 0.8.7h with PIA and Spine.

All our devices are cisco, and cannot locate the issue as everything shows ok.
The localhost and the Cisco CPU graphs are still logging. Its just the bandwidth in/out that has stopped. If I debug the graph the rrd reports as ok. and on debug spine does not report issue.

Any new interfaces I add show nan value. My ICMP graph has also stopped for some reason,

Can any one help me to find whats going on here please.

[l33byt]

Running a debug on the poller, it is getting the info from the host therefore I dont believe this to be poller related;

03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3341] SS[0] SERVER: /usr/share/cacti/site/scripts/ss_fping.php ss_fping 10.1.1.1 20 ICMP , output: min:5.0110 avg:5.1797 max:6.0900 dev:0.2317 loss:0.0000
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3342] SNMP: v2: 10.1.1.1, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.2, value: 1988045619
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3342] SNMP: v2: 10.1.1.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.2, value: 2812095751
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3343] SNMP: v2: 10.1.1.1, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.3, value: 4001173914
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3343] SNMP: v2: 10.1.1.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.3, value: 1358708406
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3344] SNMP: v2: 10.1.1.1, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.11, value: 0
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3344] SNMP: v2: 10.1.1.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.11, value: 0
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3345] SNMP: v2: 10.1.1.1, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.17, value: 667547011
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3345] SNMP: v2: 10.1.1.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.17, value: 616291229
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3346] SNMP: v2: 10.1.1.1, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.18, value: 0
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3346] SNMP: v2: 10.1.1.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.18, value: 59867225
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3347] SNMP: v2: 10.1.1.1, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.20, value: 2377588046
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3347] SNMP: v2: 10.1.1.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.20, value: 3477512777
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3348] SNMP: v2: 10.1.1.1, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.21, value: 19167396
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3348] SNMP: v2: 10.1.1.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.21, value: 583477
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3349] SNMP: v2: 10.1.1.1, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.22, value: 0
03/15/2012 12:24:06 PM - SPINE: Poller[0] Host[89] DS[3349] SNMP: v2: 10.1.1.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.22, value: 230

This is for a new host showing nan values.

A working graph show this too (Is this where my problem is?)

03/15/2012 11:57:05 AM - POLLER: Poller[0] CACTI2RRD: /usr/bin/rrdtool update /var/lib/cacti/rra/onwsb-1std1_traffic_in_2398.rrd --template traffic_out:traffic_in 1331812625:2945149511:3078751393

[gandalf]

Please use debugging procedure shown at 2nd link of my sig
R.