[SOLVED] Graph missing data

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

maunded
Posts: 7
Joined: Thu Mar 18, 2010 5:43 pm

[SOLVED] Graph missing data

Post by maunded »

Hi,

I have a graph on an external ADSL2+ connection that is limited to around 10Mb. The graph i have seems to fail when its data goes over 5Mb.

Image

The inbound data in the circled area was about 6Mb/sec.

Graph Debug:

Code: Select all

/usr/local/bin/rrdtool graph - \
--imgformat=PNG \
--start=-86400 \
--end=-60 \
--title="fw1-juniper stats - Traffic - adsl1/0" \
--base=1000 \
--height=120 \
--width=500 \
--alt-autoscale \
--vertical-label="bits per second" \
--slope-mode \
--font TITLE:10: \
--font AXIS:6: \
--font LEGEND:8: \
--font UNIT:6: \
DEF:a="/usr/local/apache2/htdocs/cacti/rra/fw1-screenos_traffic_in_321.rrd":traffic_in:AVERAGE \
DEF:b="/usr/local/apache2/htdocs/cacti/rra/fw1-screenos_traffic_in_321.rrd":traffic_out:AVERAGE \
CDEF:cdefa=a,8,* \
CDEF:cdeff=b,-8,* \
CDEF:cdefh=b,8,* \
AREA:cdefa#00CF0033:""  \
LINE1:cdefa#00CF00FF:"Inbound"  \
GPRINT:cdefa:LAST:" Current\:%8.2lf %s"  \
GPRINT:cdefa:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:cdefa:MAX:"Maximum\:%8.2lf %s\n"  \
AREA:cdeff#002A9733:""  \
LINE1:cdeff#002A97FF:"Outbound"  \
GPRINT:cdefh:LAST:"Current\:%8.2lf %s"  \
GPRINT:cdefh:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:cdefh:MAX:"Maximum\:%8.2lf %s" 
Data source debug:

Code: Select all

/usr/local/bin/rrdtool create \
/usr/local/apache2/htdocs/cacti/rra/fw1-screenos_traffic_in_321.rrd \
--step 60  \
DS:traffic_in:COUNTER:120:0:100000000000 \
DS:traffic_out:COUNTER:120:0:100000000000 \
RRA:AVERAGE:0.5:1:500 \
RRA:AVERAGE:0.5:1:600 \
RRA:AVERAGE:0.5:6:700 \
RRA:AVERAGE:0.5:24:775 \
RRA:AVERAGE:0.5:288:797 \
RRA:MAX:0.5:1:500 \
RRA:MAX:0.5:1:600 \
RRA:MAX:0.5:6:700 \
RRA:MAX:0.5:24:775 \
RRA:MAX:0.5:288:797 \

I have full logging enabled and there are no errors in the logfile.

I have other graphs based on the same template that are showing over 800Mb/sec (switches), so I cant understand why my graph isnt working.

Thnks
D.
Last edited by maunded on Mon Mar 29, 2010 4:22 pm, edited 1 time in total.
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

If you are using spine 0.8.7e, turn logging to medium. Spine hides "timeouts" now in the latest version unless under medium. You should increase your snmp timeout.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
maunded
Posts: 7
Joined: Thu Mar 18, 2010 5:43 pm

Post by maunded »

I dont see any errors, the output looks to be correct

Code: Select all

03/26/2010 03:03:07 PM - CMDPHP: Poller[0] Host[43] DS[320] SNMP: v1: fw1-hendra.smcbne.com, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.2, output: 317042446  
03/26/2010 03:03:07 PM - CMDPHP: Poller[0] Host[43] DS[320] SNMP: v1: fw1-hendra.smcbne.com, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.2, output: 1136151325  
EDIT: I should add that Im not using spine, only cmd.php
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

Well, that's your first mistake. It's an snmp timeout for sure then.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Post by gandalf »

What is the rrd files MAX for that data source? I suggest setting this to "U" (use rrdtool tune) to make sure that data is not capped for the time being.
R.
maunded
Posts: 7
Joined: Thu Mar 18, 2010 5:43 pm

Post by maunded »

I updated to spine and tested with the same result, I then set the rrd max to 'U' for the data source and still have the same result.

Image

The first gap is where I tested with spine running instead of cmd.php, the second where i set the data source to max=U.
Heres my graph and data source debug:

Code: Select all

/usr/local/bin/rrdtool graph - \
--imgformat=PNG \
--start=-86400 \
--end=-60 \
--title="fw1-juniper stats - Traffic - adsl1/0" \
--base=1000 \
--height=120 \
--width=500 \
--alt-autoscale \
--vertical-label="bits per second" \
--slope-mode \
--font TITLE:10: \
--font AXIS:6: \
--font LEGEND:8: \
--font UNIT:6: \
DEF:a="/usr/local/apache2/htdocs/cacti/rra/fw1-screenos_traffic_in_321.rrd":traffic_in:AVERAGE \
DEF:b="/usr/local/apache2/htdocs/cacti/rra/fw1-screenos_traffic_in_321.rrd":traffic_out:AVERAGE \
CDEF:cdefa=a,8,* \
CDEF:cdeff=b,-8,* \
CDEF:cdefh=b,8,* \
AREA:cdefa#00CF0033:""  \
LINE1:cdefa#00CF00FF:"Inbound"  \
GPRINT:cdefa:LAST:" Current\:%8.2lf %s"  \
GPRINT:cdefa:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:cdefa:MAX:"Maximum\:%8.2lf %s\n"  \
AREA:cdeff#002A9733:""  \
LINE1:cdeff#002A97FF:"Outbound"  \
GPRINT:cdefh:LAST:"Current\:%8.2lf %s"  \
GPRINT:cdefh:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:cdefh:MAX:"Maximum\:%8.2lf %s" 

Code: Select all

/usr/local/bin/rrdtool create \
/usr/local/apache2/htdocs/cacti/rra/fw1-screenos_traffic_in_321.rrd \
--step 60  \
DS:traffic_in:COUNTER:120:0:U \
DS:traffic_out:COUNTER:120:0:U \
RRA:AVERAGE:0.5:1:500 \
RRA:AVERAGE:0.5:1:600 \
RRA:AVERAGE:0.5:6:700 \
RRA:AVERAGE:0.5:24:775 \
RRA:AVERAGE:0.5:288:797 \
RRA:MAX:0.5:1:500 \
RRA:MAX:0.5:1:600 \
RRA:MAX:0.5:6:700 \
RRA:MAX:0.5:24:775 \
RRA:MAX:0.5:288:797 \
I have logging set to medium and there are no warnings or errors in the log file.
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Post by gandalf »

Please do not only change the data source but the rrd file itself (cacti won't do that for you). Use rrdtool tune to change the MAX
R.
maunded
Posts: 7
Joined: Thu Mar 18, 2010 5:43 pm

Post by maunded »

Fantastic! that seems to have done the trick. Appreciate your guidance.
mvoity
Posts: 19
Joined: Fri Apr 02, 2010 3:26 pm
Location: BTV

Post by mvoity »

<Stupid Question>
How do I change the max=u in rrdtool?

</stupid question>

My graphs look like this:
Attachments
graph.JPG
graph.JPG (33.32 KiB) Viewed 4741 times
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Post by gandalf »

Please see "man rrdtune", e.g.

Code: Select all

rrdtool tune <file> --maximum <ds-name>:<new max value>
R.
mvoity
Posts: 19
Joined: Fri Apr 02, 2010 3:26 pm
Location: BTV

Post by mvoity »

Is there a way to make it a global setting? It does to every graph i have.
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Post by gandalf »

Scripts to walk your rra directory have already been posted. Change the Data Template to make sure all new rrd files are created correctly.
R.
mvoity
Posts: 19
Joined: Fri Apr 02, 2010 3:26 pm
Location: BTV

Post by mvoity »

I did the following connad:
rrdtool tune localhost_proc_7.rrd --maximum proc:U

and the graph still has hole on it:

any other ideas?
Attachments
graph2.JPG
graph2.JPG (29.38 KiB) Viewed 4692 times
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Post by gandalf »

Please see 2nd link of my sig, especially the double poller issue
R.
mvoity
Posts: 19
Joined: Fri Apr 02, 2010 3:26 pm
Location: BTV

Post by mvoity »

I followed the debugging and can still can not figure out why i have gaps in my graphs.

When i did:
rrdtool fetch localhost_proc_7.rrd AVERAGE

I found lots of "nan" I know this is not right.

When i did :
rrdtool info localhost_proc_7.rrd

What is my problem?

I see this:
filename = "localhost_proc_7.rrd"
rrd_version = "0003"
step = 300
last_update = 1270425002
header_size = 1892
ds[proc].index = 0
ds[proc].type = "GAUGE"
ds[proc].minimal_heartbeat = 600
ds[proc].min = 0.0000000000e+00
ds[proc].max = NaN
ds[proc].last_ds = "101"
ds[proc].value = 2.0200000000e+02
ds[proc].unknown_sec = 0
rra[0].cf = "AVERAGE"
rra[0].rows = 600
rra[0].cur_row = 49
rra[0].pdp_per_row = 1
rra[0].xff = 5.0000000000e-01
rra[0].cdp_prep[0].value = NaN
rra[0].cdp_prep[0].unknown_datapoints = 0
rra[1].cf = "AVERAGE"
rra[1].rows = 700
rra[1].cur_row = 312
rra[1].pdp_per_row = 6
rra[1].xff = 5.0000000000e-01
rra[1].cdp_prep[0].value = 2.0200000000e+02
rra[1].cdp_prep[0].unknown_datapoints = 2
rra[2].cf = "AVERAGE"
rra[2].rows = 775
rra[2].cur_row = 307
rra[2].pdp_per_row = 24
rra[2].xff = 5.0000000000e-01
rra[2].cdp_prep[0].value = 1.1869768680e+03
rra[2].cdp_prep[0].unknown_datapoints = 9
rra[3].cf = "AVERAGE"
rra[3].rows = 797
rra[3].cur_row = 57
rra[3].pdp_per_row = 288
rra[3].xff = 5.0000000000e-01
rra[3].cdp_prep[0].value = 9.2940402013e+03
rra[3].cdp_prep[0].unknown_datapoints = 177
rra[4].cf = "MAX"
rra[4].rows = 600
rra[4].cur_row = 425
rra[4].pdp_per_row = 1
rra[4].xff = 5.0000000000e-01
rra[4].cdp_prep[0].value = NaN
rra[4].cdp_prep[0].unknown_datapoints = 0
rra[5].cf = "MAX"
rra[5].rows = 700
rra[5].cur_row = 239
rra[5].pdp_per_row = 6
rra[5].xff = 5.0000000000e-01
rra[5].cdp_prep[0].value = 1.0100000000e+02
rra[5].cdp_prep[0].unknown_datapoints = 2
rra[6].cf = "MAX"
rra[6].rows = 775
rra[6].cur_row = 231
rra[6].pdp_per_row = 24
rra[6].xff = 5.0000000000e-01
rra[6].cdp_prep[0].value = 1.0100000000e+02
rra[6].cdp_prep[0].unknown_datapoints = 9
rra[7].cf = "MAX"
rra[7].rows = 797
rra[7].cur_row = 48
rra[7].pdp_per_row = 288
rra[7].xff = 5.0000000000e-01
rra[7].cdp_prep[0].value = 1.0100000000e+02
rra[7].cdp_prep[0].unknown_datapoints = 177
Post Reply

Who is online

Users browsing this forum: No registered users and 1 guest