Problem with 10 Gigabit Interfaces (10g)

[knallfrosch]

Hello everyone,
I'm puzzled by my new routers and Cacti.
It seems that for all interfaces (physical & port channels) starting with 10G my routers report 4294967295 as the ifSpeed. Although this is "a lot", it is not quite enough because the data sources are limited to this value .

This looks a lot like 2^32-1, so I figure that the interface speeds are queried using some "legacy" counter from SNMPv1-times?

I'm still running 0.8.7e + spine + boost...

Best regards
Knallfrosch

[BSOD2600]

http://forums.cacti.net/viewtopic.php?f=6&t=24526

[knallfrosch]

Hi BSOD2600,
sorry, you are wrong. This isn't a SNMP 32/64 bit thing of the interface counters. I run into this pretty long ago with gigabit Ethernet

I'm using the 64 bit counters already and the graphs correctly display significantly more than a few 100mbit/s...
The problem is that the bandwith (and thus the maximum that the rra-files are configured with and also the data sources) are set not to 10gbit but to 4.xxxgibt/s. Look at the screenshot, the Interface is called Ethernet 'cause it's a Cisco Nexus, no more "TenGigabitEthernet" names there. I understand that no value exceeding this maximum would be entered into the RRA files.

It seems the reason is that the oid used for ifSpeed in ...interface.xml (.1.3.6.1.2.1.2.2.1.5) only is a 32bit counter. Seems that 1.3.6.1.2.1.31.1.1.1.15 would be the right one for interfaces with a speed exceeding roughly 4gig/s..... so this value woud need to be used if (and only if) the normal ifSpeed value is 2^32-1.
At least this is what I find from our Nexus... can't speak for other cisco routers/switches, also not for other vendors.

Unfortunately I don't have the slightest idea how to build this with cacti, just using the other OID wouldn't work, because we use low speed interfaces (that only have 32 bit counters) as well as port channels with 40Gig/s.

Regards
Knallfrosch

[BSOD2600]

cacti set the max speed based on the ifSpeed at the time the port was originally graphed. Since it's to low...

1) change the min/max to the correct number in the data source
2) use the rrdtool tune command to fix the rrd file(s).

[jehan.procaccia]

Hello

I am facing a similar problem with a cisco 6500 with 10g interfaces, graph cannot go over 114Mb for a 10G interface !
I run a netperf between 2 servers through the c6500 TenGiga interface, the program netperf show a throughput of 4.79 Giga.
at the same time, here's what the counters looks like:

within cisco ios:
c6509-01#show interfaces tenGigabitEthernet 6/2
...
5 minute input rate 4939301000 bits/sec, 407210 packets/sec
5 minute output rate 25215000 bits/sec, 45025 packets/sec

in the rra:
[root@monitor rra]# rrdtool fetch cisco_6500_backbone_traffic_in_1110.rrd MAX
....
1307692500: 3.2861890257e+06 3.3123242858e+06
1307692800: 9.6454004702e+06 3.3189163048e+06
1307693100: nan nan

with snmpwalk on the oid
[root@monitor rra]# /usr/bin/snmpwalk -Oav -v2c -c intro 157.159.8.2 .1.3.6.1.2.1.2.2.1.16.325
Counter32: 1935947526

none of this values are similar !?, and the graph doesn't go over 114M , a 4th different value

my traffic interface is set to 64 bits
[root@monitor rra]# rrdtool info cisco_6500_backbone_traffic_in_1110.rrd
filename = "cisco_6500_backbone_traffic_in_1110.rrd"
rrd_version = "0003"
step = 300
last_update = 1307698201
ds[traffic_in].type = "COUNTER"
ds[traffic_in].minimal_heartbeat = 600
ds[traffic_in].min = 0.0000000000e+00
ds[traffic_in].max = 4.2949672950e+09
ds[traffic_in].last_ds = "960950540"
ds[traffic_in].value = 0.0000000000e+00
ds[traffic_in].unknown_sec = 0
ds[traffic_out].type = "COUNTER"
ds[traffic_out].minimal_heartbeat = 600
ds[traffic_out].min = 0.0000000000e+00
ds[traffic_out].max = 4.2949672950e+09
ds[traffic_out].last_ds = "1025904772"
ds[traffic_out].value = 4.0680000000e+01
ds[traffic_out].unknown_sec = 0

I must admint that I am lost
is this a rrd tuning pb, and wrong oid , an upper limit graph template pb , a 64 counter etc ...

Thanks for any help .

[jehan.procaccia]

Forget it ... I finally read once more
http://forums.cacti.net/viewtopic.php?f=6&t=24526

in the DataSource, last field in custom data, "OutPut Type ID must be set to "In/Out Bits (64-bit Counters)"

and that was it ! now I do have graphs up to 5 Gbytes ... (I have to figure out why my netperf cannot go further than 5G though ... but that's another pb )

-bash-3.2$ rrdtool info /usr/share/cacti/rra/cisco_6500_backbone_traffic_in_1202.rrd | more
filename = "/usr/share/cacti/rra/cisco_6500_backbone_traffic_in_1202.rrd"
rrd_version = "0003"
step = 300
last_update = 1307719201
ds[traffic_in].type = "COUNTER"
ds[traffic_in].minimal_heartbeat = 600
ds[traffic_in].min = 0.0000000000e+00
ds[traffic_in].max = 4.2949672950e+09
ds[traffic_in].last_ds = "9604141188960"
ds[traffic_in].value = 6.2754915560e+08
ds[traffic_in].unknown_sec = 0
ds[traffic_out].type = "COUNTER"
ds[traffic_out].minimal_heartbeat = 600
ds[traffic_out].min = 0.0000000000e+00
ds[traffic_out].max = 4.2949672950e+09
ds[traffic_out].last_ds = "77444037470"
ds[traffic_out].value = 2.5307347867e+06
ds[traffic_out].unknown_sec = 0
rra[0].cf = "AVERAGE"
rra[0].rows = 600

thanks .