Graph is intermittent

[polarit]

Hello Forum

I have problems with some graphs, the polls goes seemingly ok, but the graph does not update - or at least does not show any traffic.

Cacti is Version 0.8.6i
Linux is Debian 2.6.18.dfsg.1-13etch4

the log:
11/06/2008 11:15:41 AM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.6, output: 1384759965
11/06/2008 11:15:41 AM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.6, output: 93176705
11/06/2008 11:20:40 AM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.6, output: 1412398812
11/06/2008 11:20:40 AM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.6, output: 96809118
11/06/2008 11:25:40 AM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.6, output: 1436789720
11/06/2008 11:25:40 AM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.6, output: 100252689


Any hints will be much appreciated

[TheWitness]

You have two cron's or pollers running.

TheWitness

[polarit]

Nop - one poller

Only cpuload does not have this holes in the graphs, so it must be interface related.
but then again - the router has "snmp-server ifindex persist" in the config.
the only routers with this is three routers with tunnels and encryption.

One thing - it seems that whenever the traffic goes above 60-70K the graph quits, except the phys. IF

[gandalf]

Please derive from "rrdtool info" if there's a MAX defined to the data template
Reinhard

[polarit]

rrd_version = "0003"
step = 300
last_update = 1226313761
ds[traffic_out].type = "COUNTER"
ds[traffic_out].minimal_heartbeat = 600
ds[traffic_out].min = 0.0000000000e+00
ds[traffic_out].max = 9.0000000000e+03
ds[traffic_out].last_ds = "22029631"
ds[traffic_out].value = 1.8958456140e+03
ds[traffic_out].unknown_sec = 0
ds[traffic_in].type = "COUNTER"
ds[traffic_in].minimal_heartbeat = 600
ds[traffic_in].min = 0.0000000000e+00
ds[traffic_in].max = 9.0000000000e+03
ds[traffic_in].last_ds = "3621251873"
ds[traffic_in].value = 6.0588423860e+05
ds[traffic_in].unknown_sec = 0
rra[0].cf = "AVERAGE"
rra[0].rows = 600
rra[0].pdp_per_row = 1
rra[0].xff = 5.0000000000e-01
rra[0].cdp_prep[0].value = NaN
rra[0].cdp_prep[0].unknown_datapoints = 0
rra[0].cdp_prep[1].value = NaN
rra[0].cdp_prep[1].unknown_datapoints = 0
rra[1].cf = "AVERAGE"
rra[1].rows = 700
rra[1].pdp_per_row = 6
rra[1].xff = 5.0000000000e-01
rra[1].cdp_prep[0].value = 2.2839934910e+01
rra[1].cdp_prep[0].unknown_datapoints = 0
rra[1].cdp_prep[1].value = 1.0386221813e+04
rra[1].cdp_prep[1].unknown_datapoints = 0
rra[2].cf = "AVERAGE"
rra[2].rows = 775
rra[2].pdp_per_row = 24
rra[2].xff = 5.0000000000e-01
rra[2].cdp_prep[0].value = 9.3112361754e+01
rra[2].cdp_prep[0].unknown_datapoints = 0
rra[2].cdp_prep[1].value = 3.5581482580e+04
rra[2].cdp_prep[1].unknown_datapoints = 0
rra[3].cf = "AVERAGE"
rra[3].rows = 797
rra[3].pdp_per_row = 288
rra[3].xff = 5.0000000000e-01
rra[3].cdp_prep[0].value = 1.3994556365e+03
rra[3].cdp_prep[0].unknown_datapoints = 9
rra[3].cdp_prep[1].value = 5.3161133588e+05
rra[3].cdp_prep[1].unknown_datapoints = 35
rra[4].cf = "MAX"
rra[4].rows = 600
rra[4].pdp_per_row = 1
rra[4].xff = 5.0000000000e-01
rra[4].cdp_prep[0].value = NaN
rra[4].cdp_prep[0].unknown_datapoints = 0
rra[4].cdp_prep[1].value = NaN
rra[4].cdp_prep[1].unknown_datapoints = 0
rra[5].cf = "MAX"
rra[5].rows = 700
rra[5].pdp_per_row = 6
rra[5].xff = 5.0000000000e-01
rra[5].cdp_prep[0].value = 1.1688725330e+01
rra[5].cdp_prep[0].unknown_datapoints = 0
rra[5].cdp_prep[1].value = 5.2579974904e+03
rra[5].cdp_prep[1].unknown_datapoints = 0
rra[6].cf = "MAX"
rra[6].rows = 775
rra[6].pdp_per_row = 24
rra[6].xff = 5.0000000000e-01
rra[6].cdp_prep[0].value = 1.1918773051e+01
rra[6].cdp_prep[0].unknown_datapoints = 0
rra[6].cdp_prep[1].value = 5.9761697011e+03
rra[6].cdp_prep[1].unknown_datapoints = 0
rra[7].cf = "MAX"
rra[7].rows = 797
rra[7].pdp_per_row = 288
rra[7].xff = 5.0000000000e-01
rra[7].cdp_prep[0].value = 1.2462348279e+01
rra[7].cdp_prep[0].unknown_datapoints = 9
rra[7].cdp_prep[1].value = 8.9443090909e+03
rra[7].cdp_prep[1].unknown_datapoints = 35

[TheWitness]

9000 as the Max for a traffic graph seem's quite low. You may need to tune your Data Sources. It's likely one of two things happened, 1) You imported a template that modified the max in the Data Template, 2) Someone specified a Max Value that was too low.

TheWitness

[polarit]

That may be, but it doesn't make sense
The Max in the DS are 9000, but the graph stops woring at around 65Kb, which is 520000 - give or take a little.

I have set the max to 4294967295 in the GUI
Debug output :
--step 300 \
DS:traffic_out:COUNTER:600:0:4294967295 \
DS:traffic_in:COUNTER:600:0:4294967295 \
RRA:AVERAGE:0.5:1:600 \
RRA:AVERAGE:0.5:6:700 \
RRA:AVERAGE:0.5:24:775 \
RRA:AVERAGE:0.5:288:797 \
RRA:MAX:0.5:1:600 \
RRA:MAX:0.5:6:700 \
RRA:MAX:0.5:24:775 \
RRA:MAX:0.5:288:797 \

rrdtool info :
rrd_version = "0003"
step = 300
last_update = 1226427983
ds[traffic_out].type = "COUNTER"
ds[traffic_out].minimal_heartbeat = 600
ds[traffic_out].min = 0.0000000000e+00
ds[traffic_out].max = 9.0000000000e+03
ds[traffic_out].last_ds = "2336008304"
ds[traffic_out].value = NaN
ds[traffic_out].unknown_sec = 83
ds[traffic_in].type = "COUNTER"
ds[traffic_in].minimal_heartbeat = 600
ds[traffic_in].min = 0.0000000000e+00
ds[traffic_in].max = 9.0000000000e+03
ds[traffic_in].last_ds = "3869356276"
ds[traffic_in].value = NaN
ds[traffic_in].unknown_sec = 83

The last collected value is NaN, but the interface reports
5 minute input rate 544000 bits/sec, 83 packets/sec
5 minute output rate 159000 bits/sec, 82 packets/sec

The counters gets polled :
11/11/2008 07:21:17 PM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.6, output: 3848565259
11/11/2008 07:21:17 PM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.6, output: 2329205692
11/11/2008 07:26:23 PM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.6, output: 3869356276
11/11/2008 07:26:23 PM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.6, output: 2336008304
11/11/2008 07:31:19 PM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.6, output: 3891917124
11/11/2008 07:31:19 PM - CMDPHP: Poller[0] Host[176] DS[4514] SNMP: v2: 10.252.50.78, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.6, output: 2342454502

Edit:
rrdtool tune /xxxxxx_4514.rrd --maximum traffic_out 4294967295
rrdtool tune /xxxxxx_4514.rrd --maximum traffic_in 4294967295
This may have solved it

Edit (again):
Yes, it solved it
AFAIK cacti will poll max BW, when setting up the device and graph, this does obviously not work with tunnel interfaces on cisco routers.