rrds files not created with a custom data source

[crevette]

Hello,

I want to implement big rra to keep 5 min data during 3 years (I know this is big). I read the http://docs.cacti.net/node/54 , and implement as it is indicated.

When I came to create a device using this rra, all was okay in the web interface, but I see that no rrd files were created.
After some troubleshooting, I discovered in Data Sources the field Data Source Path for each interface created with this rra is empty.

The only problem I add with the howto is when I came to create an Associated Graph Templates, the part Suggested Values was empty; so I copied from Associated Graph Templates In/Out Bits

Thanks for your help

[gandalf]

The only problem I add with the howto is when I came to create an Associated Graph Templates, the part Suggested Values was empty; so I copied from Associated Graph Templates In/Out Bits

Please post a screenshot
Reinhard

[crevette]

Hello,

I deleted and created again the data sources for my equipment, now the empty has a value, but the rrd file is still not created.
If I create it myself with the defined user (www-data) I have not error message.
Even after having created the rrd, data for the data source are not collected / or commited in the rrd file.

I attach the screenshot of one of the data source,

Sincerely, thanks for your help

[gandalf]

WHISTLE
That's HUUUUGE, that rrd is!
Please follow http://docs.cacti.net/ode/283 for more help. Post your results of each step
Reinhard

[crevette]

Yeah I know this is huge.

I have a project to monitor our infrastructure with a requirement to have all the data in the last 3 years.

I'm going to to check your document ASAP; but Imy thought is have a problem before the NaN problem, as the rrd is not created. :/

Thank you

[crevette]

Here comes the result of the troubleshoot

1) Cacti log
No "warning" or "error" or "time*out"

2) Check Basic Data Gathering
the gathering seems not to be the problem, because with another data source (template: Interface - Traffic) I can retrieve data and the rr dis created by cacti without a problem.

3) Check cacti's poller
I did a poll on the host id 14 with following command
cactid --verbosity=5 14
I can see it polls the host and I see the data sources being checked except the DSs I created with the '3 years'.

5) Check rrd file updating
I can't find the 'rrdtool update <filename> --template' described.
I'm unable to find the rrd 384, 384 and 385 in the poller cache.

6) Check rrd file ownership
Permissions are fine

7) Check rrd file numbers
rrdtool info /usr/share/cacti/site/rra/saswea1a_traffic_in_
filename = "/usr/share/cacti/site/rra/saswea1a_traffic_in_384.rrd"
rrd_version = "0003"
step = 300
last_update = 1194872061
ds[traffic_in].type = "COUNTER"
ds[traffic_in].minimal_heartbeat = 600
ds[traffic_in].min = 0.0000000000e+00
ds[traffic_in].max = 1.0000000000e+08
ds[traffic_in].last_ds = "UNKN"
ds[traffic_in].value = 0.0000000000e+00
ds[traffic_in].unknown_sec = 261
ds[traffic_out].type = "COUNTER"
ds[traffic_out].minimal_heartbeat = 600
ds[traffic_out].min = 0.0000000000e+00
ds[traffic_out].max = 1.0000000000e+08
ds[traffic_out].last_ds = "UNKN"
ds[traffic_out].value = 0.0000000000e+00
ds[traffic_out].unknown_sec = 261
rra[0].cf = "AVERAGE"
rra[0].rows = 350000
rra[0].pdp_per_row = 1
rra[0].xff = 5.0000000000e-01
rra[0].cdp_prep[0].value = NaN
rra[0].cdp_prep[0].unknown_datapoints = 0
rra[0].cdp_prep[1].value = NaN
rra[0].cdp_prep[1].unknown_datapoints = 0

Thanks for your help,

[gandalf]

3) Check cacti's poller
I did a poll on the host id 14 with following command
cactid --verbosity=5 14
I can see it polls the host and I see the data sources being checked except the DSs I created with the '3 years'.

Let's stick to this one. Please find "System Utilities -> Poller Cache", filter for that host and try to find your data therein. Please respond
Reinhard

[crevette]

Hi Gandalf,

I can't find these DS in the poller cache, I should have mentionned that yesterday, as I looked as it.

Thanks for your help

[TheWitness]

Actually, that RRA only has just under two years of 5 minute data. Huge yes, efficient, no.

TheWitness

[gandalf]

Hi Gandalf,

I can't find these DS in the poller cache, I should have mentionned that yesterday, as I looked as it.

Thanks for your help

In this case, Graph Generation has failed. It would not only create the Graph and RRD definition entries but also add entries to the poller table. Please retry creating the graph and pay attention to both cacti.log and httpd's error_log
Reinhard

[crevette]

Okay I will try to create the RRA again.
please note I had / have no errors in the logs file.

it seems my problem are identical to http://forums.cacti.net/post-117127.html

[crevette]

Okay,

I tried to create the RRA a third time and it worked ...