Cacti no longer creating graphs

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

Post Reply
UKS-Gavin
Posts: 42
Joined: Fri Oct 06, 2006 7:36 am

Cacti no longer creating graphs

Post by UKS-Gavin »

Hi All,

A customer of ours has cacti setup and for some reason it is no longer creating the RRD's.

Running the debian stable version of cacti on Debian Sarge 3.1 with a custom kernel.

The system stopped graphing approximately a week ago. I've checked the file permissions and these appear fine, looking at the cacti log files i'm seeing no errors. I can see the poller running and capturing the SNMP data but it doesn't seem to update the RRA files.

To confirm that I've moved the RRD's to a temp directory, ran the poller by hand and it does not recreate the files.

Any pointers as to what to check would be greatly appreciated.

Regards,
Gavin Conway
UKSolutions.Net
User avatar
Linegod
Developer
Posts: 1626
Joined: Thu Feb 20, 2003 10:16 am
Location: Canada
Contact:

Post by Linegod »

- clear the poller cache
- Increase the log level
- check the cacti log for errors
- check the system logs for errors (/var/log/messages, etc)
--
Live fast, die young
You're sucking up my bandwidth.

J.P. Pasnak,CD
CCNA, LPIC-1
http://www.warpedsystems.sk.ca
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Post by gandalf »

Additionally,
- check file space (cacti.log file size, mysql, rrd files partition ...)
- check crontabs
- see my link on "NaN Debugging"
Reinhard
UKS-Gavin
Posts: 42
Joined: Fri Oct 06, 2006 7:36 am

Post by UKS-Gavin »

Thanks for that, in the end this was the output_poller table in mysql.

Is there any disadvantage to putting a bi-weekly/montly script in place to truncate that table?

Cheers,
Gavin
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:

Post by rony »

UKS-Gavin wrote:Is there any disadvantage to putting a bi-weekly/montly script in place to truncate that table?
You shouldn't....

The poller does this unless it exits abnormally. You should figure out why the poller isn't exiting correctly. Check out the cacti.log for more information.
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
UKS-Gavin
Posts: 42
Joined: Fri Oct 06, 2006 7:36 am

Post by UKS-Gavin »

rony wrote:
UKS-Gavin wrote:Is there any disadvantage to putting a bi-weekly/montly script in place to truncate that table?
You shouldn't....

The poller does this unless it exits abnormally. You should figure out why the poller isn't exiting correctly. Check out the cacti.log for more information.
I've looked into this, the system was running fine for nearly 2 months with no external influences and then started reporting NaN. I'll monitor it to see how it goes but if I do choose to put the truncate in will it result in any detrimental behaviour?

Thanks,
Gavin
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:

Post by rony »

Yes, loss of data.

What you propose is just a half sticky bandaid to the real problem. You need to figure out what the real problem is before you just willy nilly stick a bandaid on it. :o
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
UKS-Gavin
Posts: 42
Joined: Fri Oct 06, 2006 7:36 am

Post by UKS-Gavin »

rony wrote:Yes, loss of data
Could you give some suggestions as to what would cause the poller to crash unexpectedly?

Thanks,
Gavin
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:

Post by rony »

1. The max memory and execution time not being set high enough in your php.ini.
2. The cacti.log file exceeding the file systems max file size (typically 2 gigs).
3. Database corruption.

Ultimatly you need to look at your log and see if there is anything that would explain why this is happening.

FYI, this issue with the poller_output table can creep up on you. I would suggest that you have crontab execute a script that executes the poller than after the poller exits, counts the number of rows in the poller_output table. If the number is greater than 0, copy the cacti.log and email someone to alert them to look into the issue.
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
UKS-Gavin
Posts: 42
Joined: Fri Oct 06, 2006 7:36 am

Post by UKS-Gavin »

Thanks for that Tony, I'll get that put in place now. Much appreciated.
Post Reply

Who is online

Users browsing this forum: No registered users and 1 guest