95 percentile randomly breaking ?

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

Post Reply
Wunk
Posts: 37
Joined: Fri Mar 05, 2004 8:34 am
Contact:

95 percentile randomly breaking ?

Post by Wunk »

We've been running cacti for 2 years without problems, but since recently our 95percentile number breaks at random..

Image

The red box that used to be in front of the number disappears and it gives some wild inaccurate number that's closer to some total bandwith number then to the 95%tile.

I've seen it repair itself but after a little disappear again.., after a while this will also propagate to the weekly and monthly graphs..

Totally deleting the graph and datasource and recreating them doesn't solve the problem, and it seems to do it at random interfaces..

I'm running the latest cacti (0.8.6g) with php 4.3.11 and apache 1.33, the snmp version installed is net-snmp-5.0.9

Does anyone have any idea what might cause this ?, it's important that our 95%tile numbers are accurate, because we bill customers with them..
Jeroen Wunnink
Easyhosting.nl Sysadmin
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:

Post by rony »

How many interfaces are on that graph?

The value being displayed is above the scale on the graph, that it why it's not showing. What is your 95th percent variable in the graph item?
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
Wunk
Posts: 37
Joined: Fri Mar 05, 2004 8:34 am
Contact:

Post by Wunk »

Hi Rony,

It's a single interface where the traffic in and out are being measured (it's the standard 95 percentile option when creating a new graph that comes with cacti)

edit:

This is the graph source:

/usr/bin/rrdtool graph - \
--imgformat=PNG \
--start=-86400 \
--end=-300 \
--title="Summit48 (NovaXess) - Traffic - RMON Port 49 on/49 - Uplink (Fibre)" \
--rigid \
--base=1000 \
--height=120 \
--width=500 \
--alt-autoscale-max \
--lower-limit=0 \
--vertical-label="bits per second" \
--slope-mode \
DEF:a="/var/www/cacti/rra/summit48_traffic_in_788.rrd":traffic_in:AVERAGE \
DEF:b="/var/www/cacti/rra/summit48_traffic_in_788.rrd":traffic_out:AVERAGE \
CDEF:cdefa=a,8,* \
CDEF:cdefe=b,8,* \
AREA:cdefa#00CF00:"Inbound" \
GPRINT:cdefa:LAST:" Current\:%8.2lf %s" \
GPRINT:cdefa:AVERAGE:"Average\:%8.2lf %s" \
GPRINT:cdefa:MAX:"Maximum\:%8.2lf %s\n" \
LINE1:cdefe#002A97:"Outbound" \
GPRINT:cdefe:LAST:"Current\:%8.2lf %s" \
GPRINT:cdefe:AVERAGE:"Average\:%8.2lf %s" \
GPRINT:cdefe:MAX:"Maximum\:%8.2lf %s\n" \
COMMENT:"\n" \
HRULE:16328163.84#FF0000:"95th Percentile" \
COMMENT:"(16.33 mbit in+out)"
Jeroen Wunnink
Easyhosting.nl Sysadmin
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:

Post by rony »

I need the graph 95th variable when you editing the graph template that graph is using. Something like "|95:0:max:1|", for example.
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
Wunk
Posts: 37
Joined: Fri Mar 05, 2004 8:34 am
Contact:

Post by Wunk »

The number:
COMMENT: (|95:bits:6:total:2| mbit in+out)

And the hrule line:
HRULE: |95:bits:0:total:2|
Jeroen Wunnink
Easyhosting.nl Sysadmin
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:

Post by rony »

Try using "max" instead of "total".

Total is adding in and out together after they 95th is performed. Max will pick the higher of the two.
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
Wunk
Posts: 37
Joined: Fri Mar 05, 2004 8:34 am
Contact:

Post by Wunk »

Item # 10 HRULE: |95:bits:0:max:2|
Item # 11 COMMENT: (|95:bits:6:max:2| mbit in+out)

This results in 0Mbit on the 95th percentile scale..
Jeroen Wunnink
Easyhosting.nl Sysadmin
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:

Post by rony »

Ok, now I'm just confused... :(

Try current? Which I don't think will work.

Next, I would suggest a patch I have written...
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
Wunk
Posts: 37
Joined: Fri Mar 05, 2004 8:34 am
Contact:

Post by Wunk »

I have to add that we've been running cacti well over 2 years now, and we've been patching in that time to the newest versions.., could that result in some database inconsystency ?

If you have that patch, I'd be happy to try it :)

btw: the 'current' value kicks it to 0Mbits too
Jeroen Wunnink
Easyhosting.nl Sysadmin
Wunk
Posts: 37
Joined: Fri Mar 05, 2004 8:34 am
Contact:

Post by Wunk »

this is what's setup and the result with max:

Image
Image
Jeroen Wunnink
Easyhosting.nl Sysadmin
Wunk
Posts: 37
Joined: Fri Mar 05, 2004 8:34 am
Contact:

Post by Wunk »

If it's the patch in:
http://forums.cacti.net/viewtopic.php?t=9429

I'll give it a try
Jeroen Wunnink
Easyhosting.nl Sysadmin
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:

Post by rony »

Yes, that one, and then use the variable aggregate instead of total/max/current.
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
Wunk
Posts: 37
Joined: Fri Mar 05, 2004 8:34 am
Contact:

Post by Wunk »

That fixed it, thanks :)
Jeroen Wunnink
Easyhosting.nl Sysadmin
kbartoletta
Cacti User
Posts: 146
Joined: Tue Oct 04, 2005 4:20 pm
Location: suwanee, ga
Contact:

Post by kbartoletta »

Hey guys, sorry to dig this one up again but I was having a similiar problem in that various 95th % traffic graphs were not displaying the actual line on my graphs... exactly like the first graph screen shot posted in this thread... I downloaded the rrd.php and graph_variables.php and copied them to my /lib directory... I then changed my function to use aggregate (because I have a graphs of single interfaces with bits in and bits out... and want to get the 95th % of traffic generated in both directions.... After making these changes, my 95% line does indeed show up but for some reason the legend appears to be displaying bits, instead of MB....

my key looks like this

(38195130.73 mbit in+out)

I want this to be display in MB such as (38.20 MBit in +out)
is this possible? Sorry if this is a stupid question...

I tried to attach the image... hope it worked...

Anyone know how to change this to display
Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests