Graph creation suddenly stopped, PLEASE HELP !

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

Post Reply
henryd31
Posts: 30
Joined: Wed Apr 13, 2005 3:11 pm

Graph creation suddenly stopped, PLEASE HELP !

Post by henryd31 »

Running 0.8.6g on fc3 with cactid as a poller. The system has been running for 8 months now and all was good. Last night around 10:15PM
all graps stopped being updated. I still get the graphs with values on the description portion being presented (what would appear to be a value of last time it actually ran), but the actual graph stops at 10:15PM last night. All rrd files show as last being updated at 10:15PM, looking at the log the poller seems to be executed properly every fine minutes and all seems to complete properly. Any ideas ???
henryd31
Posts: 30
Joined: Wed Apr 13, 2005 3:11 pm

Post by henryd31 »

well, restarted the machine and still no go....tried switching to cmd.php but it times out as i have too much stuff to run...running on cactid 0.8.6e-r7...when the polling start automatically thru cron it seems to be ok...when i run it by hand this is what i get, the rrd files are still not being updated in either case....

[root@cacti cron.d]# php /var/www/html/cacti/poller.php
No log handling enabled - turning on stderr logging
Cannot find module (NONE): At line 0 in (none)
No log handling enabled - turning on stderr logging
Cannot find module (NONE): At line 0 in (none)
No log handling enabled - turning on stderr logging
Cannot find module (NONE): At line 0 in (none)
No log handling enabled - turning on stderr logging
Cannot find module (NONE): At line 0 in (none)
Argument "ssh-rsa" isn't numeric in numeric eq (==) at /usr/lib/perl5/site_perl/5.8.5/Net/SSH/Perl/Key/RSA1.pm line 94, <FH> line 4.
Argument "ssh-rsa" isn't numeric in numeric eq (==) at /usr/lib/perl5/site_perl/5.8.5/Net/SSH/Perl/Key/RSA1.pm line 94, <FH> line 4.
Allowed memory size of 8388608 bytes exhausted (tried to allocate 10 bytes)
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:

Post by rony »

There is a more up to date cactid.

Also, run the following query on you cacti database:

Code: Select all

truncate poller_output;
Make sure the poller is not running when you run that query.
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
henryd31
Posts: 30
Joined: Wed Apr 13, 2005 3:11 pm

Post by henryd31 »

rony wrote:There is a more up to date cactid.

Also, run the following query on you cacti database:

Code: Select all

truncate poller_output;
Make sure the poller is not running when you run that query.

Updated to cactid 0.8.6f which didn't seem to do much, then used the truncate command, and this time I can see the rrd files being updated and graphs seem to be coming back...so what's this all about ?
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:

Post by rony »

Something went wrong... And the poller_output table had garbage in it.

Typically this happens if a file system fills up or mysql or the poller crashes when polling.
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Post by gandalf »

Please check your memory limits for php. If you're just below the limits (defauflt=8MB) and sths going wrong, you're not getting anything out anymore. 64MB is recommended for php/cacti
Reinhard
henryd31
Posts: 30
Joined: Wed Apr 13, 2005 3:11 pm

Post by henryd31 »

lvm wrote:Please check your memory limits for php. If you're just below the limits (defauflt=8MB) and sths going wrong, you're not getting anything out anymore. 64MB is recommended for php/cacti
Reinhard
Looks like I got the same issue again, and doing "truncate poller_output" in mysql resolved it again. So, how do I increase the php memory limits on FC3 ?

Thanks !!
henryd31
Posts: 30
Joined: Wed Apr 13, 2005 3:11 pm

Post by henryd31 »

Ok, I edited php.ini and increased the value from 8MB to 64MB.
Bigger question here is whether this is something I simply should have increased or whether there are other issues I need to look into, mainly
whether I should upgrade my system. Since this is running FC3, I have to run it on rather old mysql/php combination:
PHP 4.3.11
Mysql 3.23.58

Tried the upgrade on my backup system to newer versions but it would seem there are just too many dependencies to make a clean upgrade path. As such the only way for me to go would be to find a machine with similar hardware capabilities and get it ready, or redo existing one and after words use backups to restore the data and convert, which will not be easy to have agreed to.
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Post by gandalf »

Applying cacti to a freshly installed system should not be that big of a task. It would require dumping the mysql database as told in the upgrading instructions.
Then, you'll have to copy all cacti files (including crontab) to the new cacti system, restore the mysql db and copy all existing rrd files to the new /rra directory. You may want to have a dry run before. The steps above may be repeated several times, until you're sure to not missing anything.
Reinhard
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Post by gandalf »

Splitted of the posts of polosport, see http://forums.cacti.net/viewtopic.php?t=11133
Reinhard
Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests