Nan on rrdtool fetch filename.rrd AVERAGE - no updated graph

[ocwagonboy]

I feel like a complete dork posting this but I'm been whacking my head around this for the past three days... reading every post and following the debug instructions here: http://docs.cacti.net/manual:087:4_help ... #debugging.

I need guidance and help - at least I can admit it!

1. when I run rrdtool fetch filename.rrd AVERAGE I get:
1301365200: nan
1301365500: nan
1301365800: nan

2. my graphs are nan

3. my cacti log looks ok
cacti.log --> 03/28/2011 09:11:46 PM - POLLER: Poller[0] CACTI2RRD: /usr/bin/rrdtool update /var/www/html/noname/cacti/rra/noname004_dc1_traffic_in_191.rrd --template traffic_out:traffic_in 1301364695:25668293:33056010

4. rrdtool info
[root@atlas rra]# rrdtool info test_-_noname001_dc1_noname001_load_5min_405.rrd | grep ds
ds[load_5min].index = 0
ds[load_5min].type = "GAUGE"
ds[load_5min].minimal_heartbeat = 600
ds[load_5min].min = 0.0000000000e+00
ds[load_5min].max = 5.0000000000e+02
ds[load_5min].last_ds = "U"
ds[load_5min].value = NaN
ds[load_5min].unknown_sec = 75

last_ds = "U" unprocessed? what can I do here?
load_5min.value = Nan what else can I do here?

I run crontab as root --> */5 * * * * root /usr/bin/php /var/www/html/noname/cacti/poller.php > /dev/null 2>&1

/rra is owned by root:root
all files in /rra (the rrd files) are owned by root

I did change this to cactiuser, etc but no go...

General Information
Cacti Version 0.8.7g
Cacti OS unix
SNMP Version NET-SNMP version: 5.3.2.2
RRDTool Version RRDTool 1.4.x
Hosts 21
Graphs 400
Data Sources Script/Command: 13
SNMP: 62
SNMP Query: 96
Script Query: 3
Script Query - Script Server: 229
Total: 403
Poller Information
Interval 300
Type cmd.php
Items Action[0]: 239
Action[1]: 16
Action[2]: 306
Total: 561
Concurrent Processes 8
Max Threads 1
PHP Servers 1
Script Timeout 25
Max OID 1
Last Run Statistics Time:34.1254 Method:cmd.php Processes:8 Threads:N/A Hosts:21 HostsPerProcess:3 DataSources:561 RRDsProcessed:380
PHP Information
PHP Version 5.2.10
PHP OS Linux
PHP uname Linux atlas.noname.com 2.6.18-194.32.1.el5.centos.plus #1 SMP Wed Jan 5 18:13:47 EST 2011 x86_64
PHP SNMP Installed
max_execution_time 30
memory_limit 256M

This was a working installation until I tried to update rrdtool to recompile the source

[root@atlas rra]# rrdtool -v
RRDtool 1.4.4 Copyright 1997-2010 by Tobias Oetiker <tobi@oetiker.ch>

Any other information I can provide to try to pin point the root cause?

[gandalf]

1. when I run rrdtool fetch filename.rrd AVERAGE I get:
1301365200: nan
1301365500: nan
1301365800: nan

Looks bad

2. my graphs are nan

Looks bad

Code: Select all

3. my cacti log looks ok
cacti.log --> 03/28/2011 09:11:46 PM - POLLER: Poller[0] CACTI2RRD: /usr/bin/rrdtool update /var/www/html/noname/cacti/rra/noname004_dc1_traffic_in_191.rrd --template traffic_out:traffic_in 1301364695:25668293:33056010

Looks good.
So data is fetched (assuming, the rrdtool update relates to the above rrd file).
And the rrdtool update is performed.
But we don't know if the update is accepted. RRDTool uses the MIN/MAX to cut data off. You max has been set to 500.

4. rrdtool info
[root@atlas rra]# rrdtool info test_-_noname001_dc1_noname001_load_5min_405.rrd | grep ds
ds[load_5min].index = 0
ds[load_5min].type = "GAUGE"
ds[load_5min].minimal_heartbeat = 600
ds[load_5min].min = 0.0000000000e+00
ds[load_5min].max = 5.0000000000e+02

Please use rrdtool tune to change that.
R.

[ocwagonboy]

here's an update (I've been playing around with this like crazy so I've already delete the previous rrd file):

rrdtool fetch srt001_dc1_noname_net_traffic_in_430.rrd AVERAGE

outputs:
1301541300: nan nan
1301541600: nan nan
1301541900: nan nan
1301542200: nan nan

[root@atlas rra]# rrdtool info srt001_dc1_noname_net_traffic_in_430.rrd | grep ds ds[traffic_in].index = 0
ds[traffic_in].type = "COUNTER"
ds[traffic_in].minimal_heartbeat = 600
ds[traffic_in].min = 0.0000000000e+00
ds[traffic_in].max = 1.0000000000e+07
ds[traffic_in].last_ds = "1460113248"
ds[traffic_in].value = 1.2062259136e+03
ds[traffic_in].unknown_sec = 0
ds[traffic_out].index = 1
ds[traffic_out].type = "COUNTER"
ds[traffic_out].minimal_heartbeat = 600
ds[traffic_out].min = 0.0000000000e+00
ds[traffic_out].max = 5.0000000000e+09
ds[traffic_out].last_ds = "1133020886"
ds[traffic_out].value = 1.4827043189e+03
ds[traffic_out].unknown_sec = 0


from this command:
rrdtool tune srt001_dc1_noname_net_traffic_in_430.rrd --maximum traffic_out:5000000000

1301542800: 6.0311295681e+02 7.4135215947e+02
1301543100: 5.7870229151e+02 7.4044089845e+02
1301543400: nan nan

looks like I got data... hmmm... and then nan again? I'm going to wait a few polling intervals and try again...

[ocwagonboy]

thank you Gandalf! My graphs are working again. Thanks for point out that value to me... I would have never thought that range was too low? Weird but when I boost the value by two more 00 the data started to pile in! Thanks again!