Gaps in graphs

[ichosting]

Hi,

After lots of tweaks and browsing this forum, we still have problems graphing our 1800-24G switch.

I attached the image for demostration.

We tried 1 minute polling, modifying the data sources to 1250000000 etc, but nothing works. Counters are 64 bit, even with the net-snmp rebuilded with the --enable-mfd-rewrites option. But as you can see, no succes..

Anyone an idea what is wrong?

[gandalf]

The second link of my sig should help you debugging this issue
Reinhard

[ichosting]

The second link of my sig should help you debugging this issue
Reinhard

Gandalf, thanks for your reply, unfortunaly i do not see any sig's

Edit: Now i do. I will try this out!

[neilm]

I found gaps in my graphs being caused by the poller querying hosts who's snmp daemons had stopped running which in turn caused a backlog in the poller the data never got written to the rrd files therefore never updated in to graphs which caused gaps across the majority of my graphs.

[ichosting]

Well i tried everything using debug, but nothing helps
It also looks like it still does not use more then 100 mbit. As i used 64 bits counters for everything. Very strange

[neilm]

how many hosts are you polling in total?

[ichosting]

And in hosts you mean ports or switches?

[TheWitness]

The cmd.php poller is notorious for slowness when you have an agent that fails. However, if you can get spine to build, you will be all set.

Make sure you test it from the command line before turning it on.

TheWitness

[ichosting]

The cmd.php poller is notorious for slowness when you have an agent that fails. However, if you can get spine to build, you will be all set.

Make sure you test it from the command line before turning it on.

TheWitness

Also SPINE has been configured and been tested. Also no success.
Good news is that i managed to get clean images now, but it does still not exceed 100 mbit values. If it reaches 100 mbit, it drops. Gaps are gone though by changing IfSpeed to IfHiSpeed in the DATA QUERY'S option.

[TheWitness]

This is caused by the fact that the 32bit counters overflow at right around 100MBps. This is a known limiation of snmp. The resolution is to use the 64bit counter grapns and either snmpv2 or snmpv3. If you device does not support them, you simply need to poll more frequently, say every 1 minute for this device. Then the max goes to abound 700 or so.

TheWitness

[ichosting]

The devices support SNMP V2 and it is configured right now.
I wil try more often polling then. Graphs are on 64bits

[ichosting]

Nothing works. It keeps getting to max 100 mbit. Sometimes even less (8 mbit).

There is much more traffic right now (arround 400 mbit at the moment

So the best thing is giving up now?

[TheWitness]

Post your "rrdtool info" for the files. Let's see if Reinhard was right about the max value.

TheWitness

[BSOD2600]

I bet he didn't delete his old rrd files for that device when he switched to the 64bit templates...

[ichosting]

I bet he didn't delete his old rrd files for that device when he switched to the 64bit templates...

Then you lose that bet I always create fresh ones if i change something.



Info file:

filename = "1_gbit_switch_traffic_in_78.rrd"
rrd_version = "0003"
step = 300
last_update = 1202632202
ds[traffic_in].type = "COUNTER"
ds[traffic_in].minimal_heartbeat = 600
ds[traffic_in].min = 0.0000000000e+00
ds[traffic_in].max = 1.2500000000e+09
ds[traffic_in].last_ds = "1473559908"
ds[traffic_in].value = 5.0412822990e+06
ds[traffic_in].unknown_sec = 0
ds[traffic_out].type = "COUNTER"
ds[traffic_out].minimal_heartbeat = 600
ds[traffic_out].min = 0.0000000000e+00
ds[traffic_out].max = 1.0000000000e+08
ds[traffic_out].last_ds = "2395114850"
ds[traffic_out].value = 3.3363808106e+06
ds[traffic_out].unknown_sec = 0
rra[0].cf = "AVERAGE"
rra[0].rows = 600
rra[0].pdp_per_row = 1
rra[0].xff = 5.0000000000e-01
rra[0].cdp_prep[0].value = NaN
rra[0].cdp_prep[0].unknown_datapoints = 0
rra[0].cdp_prep[1].value = NaN
rra[0].cdp_prep[1].unknown_datapoints = 0
rra[1].cf = "AVERAGE"
rra[1].rows = 700
rra[1].pdp_per_row = 6
rra[1].xff = 5.0000000000e-01
rra[1].cdp_prep[0].value = 0.0000000000e+00
rra[1].cdp_prep[0].unknown_datapoints = 0
rra[1].cdp_prep[1].value = 0.0000000000e+00
rra[1].cdp_prep[1].unknown_datapoints = 0
rra[2].cf = "AVERAGE"
rra[2].rows = 775
rra[2].pdp_per_row = 24
rra[2].xff = 5.0000000000e-01
rra[2].cdp_prep[0].value = 1.2071734378e+07
rra[2].cdp_prep[0].unknown_datapoints = 1
rra[2].cdp_prep[1].value = 4.2013670219e+07
rra[2].cdp_prep[1].unknown_datapoints = 0
rra[3].cf = "AVERAGE"
rra[3].rows = 797
rra[3].pdp_per_row = 288
rra[3].xff = 5.0000000000e-01
rra[3].cdp_prep[0].value = 1.7027074576e+08
rra[3].cdp_prep[0].unknown_datapoints = 19
rra[3].cdp_prep[1].value = 4.6703613929e+08
rra[3].cdp_prep[1].unknown_datapoints = 32
rra[4].cf = "MAX"
rra[4].rows = 600
rra[4].pdp_per_row = 1
rra[4].xff = 5.0000000000e-01
rra[4].cdp_prep[0].value = NaN
rra[4].cdp_prep[0].unknown_datapoints = 0
rra[4].cdp_prep[1].value = NaN
rra[4].cdp_prep[1].unknown_datapoints = 0
rra[5].cf = "MAX"
rra[5].rows = 700
rra[5].pdp_per_row = 6
rra[5].xff = 5.0000000000e-01
rra[5].cdp_prep[0].value = 2.5205796968e+06
rra[5].cdp_prep[0].unknown_datapoints = 0
rra[5].cdp_prep[1].value = 1.6660315144e+06
rra[5].cdp_prep[1].unknown_datapoints = 0
rra[6].cf = "MAX"
rra[6].rows = 775
rra[6].pdp_per_row = 24
rra[6].xff = 5.0000000000e-01
rra[6].cdp_prep[0].value = 2.5205796968e+06
rra[6].cdp_prep[0].unknown_datapoints = 1
rra[6].cdp_prep[1].value = 1.4119176774e+07
rra[6].cdp_prep[1].unknown_datapoints = 0
rra[7].cf = "MAX"
rra[7].rows = 797
rra[7].pdp_per_row = 288
rra[7].xff = 5.0000000000e-01
rra[7].cdp_prep[0].value = 2.5205796968e+06
rra[7].cdp_prep[0].unknown_datapoints = 19
rra[7].cdp_prep[1].value = 1.4119176774e+07
rra[7].cdp_prep[1].unknown_datapoints = 32



Maybe i overlook something (too long playing with it )

Thanks for all your help!