Disk filled up, now graphs are emtpy

[mmason]

Cacti 0.8.6h (I think - no way to ask it what version it is) running under Debian.
I think I have two problems - one from /var filling up, another from logrotate?

My /var filled up late on Friday. When I got in today (Monday) I found around 500 poller processes running. I deleted 3 gigs of mysql logs, and the processes did whatever they wanted to do and exited.

But, now all of my graphs are empty (although the old data is still there).

All of the entries in the RRD files (or at least all of the ones I looked at) since the disk filled up are NaN, up until Sunday (yesterday) at 6:25 am, which is when the cron weekly runs (logrotate, etc), and there are no entries after that. The logrotate entry for cacti is the one installed by cacti. The RRD files are owned by www-data, which is correct.

/var/log/cacti/cacti.log shows the expected entries - such as
> 05/15/2006 05:05:08 PM - CMDPHP: Poller[0] Host[7] DS[1227] SNMP: v2: qad-c-switch, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.1 6.6, output: 2300023551
but the data doesn't seem to be getting into the rrd files correctly.

I turned logging all the way up, but still didn't see anything in the log files that sounds like an error.

Something else I noticed - I try clearing the poller cache, but the poller cache doesn't empty out - it looks like many megabytes, or perhaps many tens of megabytes.

Any ideas on what might be wrong, or debugging suggestions?

[gandalf]

PLease trx to truncate the table from mysql command line (or phpmyadmin or the like). Then, you may want to give php more than the 8MB default of memory (see php.ini) and perhaps some more time to complete (sth like runtime in php.ini)
Reinhard

[mmason]

[quote="lvm"]PLease trx to truncate the table from mysql command line (or phpmyadmin or the like). Then, you may want to give php more than the 8MB default of memory (see php.ini) and perhaps some more time to complete (sth like runtime in php.ini)
Reinhard[/quote]

Which table(s)? I'm not a mysql wizard, but I'm pretty sure I successfully truncated the poller_item and poller_output tables, which were the two large ones, but "view poller cache" still shows the same number of items.

[mmason]

Oops! I spoke too soon. That seems to have done it, there are data in my graphs again. Thanks!

Should I file a bug report on this?

[gandalf]

I don't suppose so. It is recommended to increase php memory size to avoid this problem. The problem is well know and will be corrected with cacti 0.9, AFAIK
Reinhard

[mmason]

Ok, I had assumed the problem was directly related to /var filling up, but I guess it is indirectly related.

Thanks again for the help!

[gandalf]

To be honest, there are multiple reason for this. I assume, more than I can imagine. The one I shot at was one of the most common.
Reinhard

[TheWitness]

We should just publish a patch on the website. I have already released it to the forum. You just have to find it. What do you think?

Larry