New data template not painting graphs

[azacan]

Hi all,

I have been working with Cacti during last days but I have not been able to paint a graph with Interface traffic for my devices with 5 minutes poller interval.
I am using Cacti 0.8.7c, I have created a new Data Template for this, but with no luck. My data template is a copy of Interface - traffic template, but without hourly (1 minute average) selected, with Step 300 and Heartbeat 600.

Do I need to define host or graph templates to successfully apply this? I have tried to apply to an existing data source, changing the data template and saving, I have also tried this deleting the rrd file, but after applying the new data template, the rrd is not created, so there is no new graph. I do not know what else to try.
Could anybody help me?

Thank you very much in advance!
BR

[gandalf]

but without hourly (1 minute average) selected, with Step 300 and Heartbeat 600.

That won't work. Please see the sticky thread related to 1 min polling in this Forum. Those parameters don't match.
R.

[azacan]

That won't work. Please see the sticky thread related to 1 min polling in this Forum. Those parameters don't match.
R.

Thank you very much for your reply Gandalf.

I have read the full thread you told me, but still with no success.
I have created my own 5 min RRA:
Name Step Rows Timespan (sec.)
5 min - 5 min average - 1 hour view 1 288 3600
5 min - 5 min average - 1 day view 1 864 86400
5 min - 15 min average - 1 week view 3 2976 604800
5 min - 30 min average - 1 month view 6 4320 2678400
5 min - 60 min average - 1 year view 12 26280 31536000

After I have created a Data template, copied from Interface - traffic (my default data template Interface -traffic step is 60 sec), but configured with this RRAs. Changing the step to 300 and the heartbeat to 600, both for traffic_in and traffic_out.

So I have tried to modify 1 of the data sources already being painted, I applied new data template, no success. I tried deleting the old .rrd files for this data source, no success. I tried creating manually the .rrd file, no success.

I decide to create a new graph template, copied from the Interface -Traffic (bits/sec). But with every graph item associated to my data template (5 min one).

So I go to devices, click the desired one, click to Create graphs for this hsot. In the next screen under the Graph templates in the drop-down list I pick the graph template created by me, so I choose a port of the device, select the graph type (In-Out bis 64-bit counter) and click to create. The result is that 2 graphs are being created, I guess one from my graph template and the other one from the default graph template (because of the appearance and the names). So when I go to Data Sources I see the one I guess is created with default graph-template that is still with Poller Interval 1 minute, and the other one with my graph-template with 5 minutes Poller interval.
When I go to graphs the one created with the default template is ok painted, but the one created with my graph template says "The RRD file does not exist"

This is the data source debug of the one with the data template created by me:

Data Source Debug

/usr/bin/rrdtool create \
/var/www/html/rra/ssgprsmus01_traffic_out_73.rrd \
--step 300 \
DS:traffic_out:COUNTER:600:0:100000000 \
DS:traffic_in:COUNTER:600:0:100000000 \
RRA:AVERAGE:0.5:1:288 \
RRA:AVERAGE:0.5:1:864 \
RRA:AVERAGE:0.5:3:2976 \
RRA:AVERAGE:0.5:6:4320 \
RRA:AVERAGE:0.5:12:26280 \
RRA:MIN:0.5:1:288 \
RRA:MIN:0.5:1:864 \
RRA:MIN:0.5:3:2976 \
RRA:MIN:0.5:6:4320 \
RRA:MIN:0.5:12:26280 \
RRA:MAX:0.5:1:288 \
RRA:MAX:0.5:1:864 \
RRA:MAX:0.5:3:2976 \
RRA:MAX:0.5:6:4320 \
RRA:MAX:0.5:12:26280 \
RRA:LAST:0.5:1:288 \
RRA:LAST:0.5:1:864 \
RRA:LAST:0.5:3:2976 \
RRA:LAST:0.5:6:4320 \
RRA:LAST:0.5:12:26280 \

Here is the data source debug of the other one, the one created with the default templates:
/usr/bin/rrdtool create \
/var/www/html/rra/ssgprsmus01_traffic_in_74.rrd \
--step 60 \
DS:traffic_in:COUNTER:120:0:100000000 \
DS:traffic_out:COUNTER:120:0:100000000 \
RRA:AVERAGE:0.5:1:10080 \
RRA:AVERAGE:0.5:1:25920 \
RRA:AVERAGE:0.5:24:2250 \
RRA:AVERAGE:0.5:6:9000 \
RRA:AVERAGE:0.5:288:797 \
RRA:MIN:0.5:1:10080 \
RRA:MIN:0.5:1:25920 \
RRA:MIN:0.5:6:9000 \
RRA:MIN:0.5:24:2250 \
RRA:MIN:0.5:288:797 \
RRA:MAX:0.5:1:10080 \
RRA:MAX:0.5:1:25920 \
RRA:MAX:0.5:6:9000 \
RRA:MAX:0.5:24:2250 \
RRA:MAX:0.5:288:797 \
RRA:LAST:0.5:1:10080 \
RRA:LAST:0.5:1:25920 \
RRA:LAST:0.5:6:9000 \
RRA:LAST:0.5:24:2250 \
RRA:LAST:0.5:288:797 \

...73.rrd does not exist and ...74.rrd does exist.

Do you know what could be happening? Any clue?

Thank you very much!

BR

[gandalf]

Now I'm worried.
When using a STEP=60, this is usually called a "1 min polling". This requires specific "1 min. RRAs", a full set of them. You won't use heartbeat=600 anywhere.
So I'm at a loss what you want to achive now. 1 min polling or 5 min polling.
R.

[azacan]

So I'm at a loss what you want to achive now. 1 min polling or 5 min polling.
R.

Sorry, maybe I´ve not been very clear, also my english is not very good.
My Cacti version came with the data template of Interface - Traffic for 1 minute polling (60 step, 120 heartbeat). But I am concerned about the load in my devices (some of then have lot of interfaces) and also my Cacti device, so I would like to configure a 5 minutes poller. And maybe for some kind of things use 1 minute poller and for others use 5 min.

Thanks!

BR

[gandalf]

From my point of view, 1 min polling is currently broken. I'm almost at the point to recommend deleting that rra. If it is used with the others, the result is simply broken.
You will require a complete set of rra's adjusted to 1 min polling to make it work. There's a writeup of this in this forum. Not recommended for beginners, but don't hesitate to try. You will learn a lot about using rrdtool, then.
R.

[azacan]

Hi gandalf,

Thanks for your help. It is very kind of you answering such amount of threads and questions!

Why do you think my 1 min poll is broken? The 1 min poller is the one that came with the instalation, and the used for all my graphs. I have not changed any of this one. It is working ok and if I add new graphs it aslo works ok. Why do you think I should delete it?
I would like to be able to create a new data template and paint graphs with it before deleting the templates now being used by my graphs.

About the 5 min poller, the one I want to create from 0, what is wrong in what I have done? Are the RRAs not ok? I created them following the advices of the sticky 1 min poller thread. What are the steps after creating the RRAs? Create data template, create graph template and create new graph using this template? That´s all?

Thanks!
BR

[gandalf]

The 1 min poller is the one that came with the instalation, and the used for all my graphs.

I know. That's why I said that it is broken.
Again: the Cacti 1 min polling rra's are NOT complete. It is very easy to break things.

You will require a complete set of rra's and not only a single one.
And there's no way back. Once you've set up 1 min polling for a device, you can't change existing rrd files back to 5 min and vice versa.
Setting up 1 min polling is described in a sticky thread in this forum.

R.

[azacan]

Thanks for the reply gandalf! To be honest I still didn´t get why the rra´s are not ok for 1 min polling, you mean the ones that come with the instalation are not ok?

Apart from this, it is very good to know that a device should be configured from the beginning with the poller/rras you want to use and no way back (I guess through news device, graph and data templates.), I didn´t know bout this.

I will try my 5 min poller and rra´s from the beginning for a new device. The RRAs I paste above are ok for 5 min poller, right?

Thanks very much!

BR

[gandalf]

Thanks for the reply gandalf! To be honest I still didn´t get why the rra´s are not ok for 1 min polling, you mean the ones that come with the instalation are not ok?

Yes, they are not complete.

Apart from this, it is very good to know that a device should be configured from the beginning with the poller/rras you want to use and no way back (I guess through news device, graph and data templates.), I didn´t know bout this.

Fine

Simply tell me, what consolidation levels you want to use and I'll tell you how to define the whole set of rra's required. Then, we walk through to the data template setting (you will require a whole new set of data templates for each data template that shall be used in 1 min polling).
Then, a whole new set of graph templates is required.
To group the, you will then need a set of host templates for 1 min polling.

But let's start with the rra's. Tell me your requirements
R.

[azacan]

Thank you so much!!!!!

My requirements would be, for the 5min poller:

5 min average - 1 hour view
5 min average - 1 day view
15 min average - 1 week view
30 min average - 1 month view
60 min average - 1 year view

The RRAs I prepared for this are based in the sticky 1 min thread, but applied to my 5 min poller requirement so:

Name Step Rows Timespan (sec.)
5 min - 5 min average - 1 hour view 1 288 3600
5 min - 5 min average - 1 day view 1 864 86400
5 min - 15 min average - 1 week view 3 2976 604800
5 min - 30 min average - 1 month view 6 4320 2678400
5 min - 60 min average - 1 year view 12 26280 31536000

And the storage are, respectively:
1 day
3 days
31 days
90 days
3 years

Are they fine?

Thanks gandalf!!!!

BR

[gandalf]

Here is the data source debug of the other one, the one created with the default templates:
/usr/bin/rrdtool create \
/var/www/html/rra/ssgprsmus01_traffic_in_74.rrd \
--step 60 \

From this is deduced that you want to use 1 min polling.

But in your last post, you only mentioned 5 min polling.

I'm very confused about what you are trying to achieve. 1 min polling or 5 min polling?
Please select ONE and only ONE.
R.

[azacan]

sorry gandalf, I thought this was clear:

Sorry, maybe I´ve not been very clear, also my english is not very good.
My Cacti version came with the data template of Interface - Traffic for 1 minute polling (60 step, 120 heartbeat). But I am concerned about the load in my devices (some of then have lot of interfaces) and also my Cacti device, so I would like to configure a 5 minutes poller.

BR

I want to achieve 5MIN poller configuration.

Thanks!!

BR

[gandalf]

So you have

5 min average - 1 hour view - include data for 1 day
5 min average - 1 day view - include data for 3 days
15 min average - 1 week view - include data for 31 days
30 min average - 1 month view - include data for 90 days
60 min average - 1 year view - include data for 3 years

The

5 min average - 1 hour view - include data for 1 day

makes no sense, IMHO. A 1 hour view would only include 12 data points, a very coarse graph. So I'll drop this one.

The formula to calculate the required STEP size is
consolidation interval / polling interval = STEP

5 min average = 1
15 min average = 3
30 min average = 10
60 min average = 20

The formula for the amount of PDPs (storage) is:
Storage Duration / consolidation interval = Storage Duration / (poller interval*STEP) = number of PDPs
In your example:

5 min average - include data for 3 days = 864
15 min average - include data for 31 days = 2976
30 min average - include data for 90 days = 4320
60 min average - include data for 3 years = 26352

So i have the same as you did (apart from the fact that I used 366 as the number of days per year)
R.

[azacan]

Hi gandalf!

I am back

I have been trying to define a new graph using a script with my new RRAs, but no luck man. I am starting to think Cacti was not successfully instaled (maybe something about users permissions or so) when I started to work with this Cacti it was already installed, but I am thinking about to reinstall.

Let me tell you what I did. I follow the documentation step by step (http://docs.cacti.net/manual:087:3a_adv ... ut_methods) I used the same script, the one provided with CACTI, crate Data Input Method, Data Template (with news RRAs) and Graph Template. I create the device using this, but when trying to see the graph... The RRD file does not exist!

I thought it was maybe because of the RRAs or the script so I deleted the device and create a new one, and also used a already existing data input method (linux logged users) but the situation is the same, the RRD file is not being created. I have followed the threads in the forum about this and give permissions to every users to rra and log file, also make root the owner (poller is in the root crontab). I don´t know what else could I do...

Here you can find the debug:

RRDTool Command:

/usr/bin/rrdtool graph - \
--imgformat=PNG \
--start=-86400 \
--end=-300 \
--title="CACTI1 - Logged in Users" \
--rigid \
--base=1000 \
--height=120 \
--width=500 \
--alt-autoscale-max \
--lower-limit=0 \
--vertical-label="users" \
--slope-mode \
--font TITLE:10: \
--font AXIS:8: \
--font LEGEND:8: \
--font UNIT:8: \
DEF:a="/var/www/html/rra/cacti1_users_77.rrd":users:AVERAGE \
AREA:a#4668E4FF:"Users" \
GPRINTLAST:"Current\:%8.0lf" \
GPRINTAVERAGE:"Average\:%8.0lf" \
GPRINTMAX:"Maximum\:%8.0lf"

RRDTool Says:

ERROR: opening '/var/www/html/rra/cacti1_users_77.rrd': No such file or directory


Thank you very much!