Troubleshooting poller.php

[eegilbert]

Hello, yesterday morning cacti stopped graphing. I've been trying to resolve this but I have not had any revelations. I am also sure I didn't change anything at the time cacti stopped graphing.

What's preplexing is when i manually run the poller from the command line, as either the root user or the cactiuser, I don't get any useful information:

/usr/bin/php /var/www/htdocs/cacti/poller.php > /tmp/cacti.log 2>&1

09/21/2006 12:10:02 PM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/local/cactid/bin/cactid, ARGS: 0 146]
Waiting on 1/1 pollers.

I've tried adding a log entry in the cactid.conf file and nothing ever gets logged. I see the crontab firing off the above command at 5 min intervals like it should. I've enabled DEBUG and looking through /var/www/htdocs/cacti/log/cacti.log doesn't show me any errors that I can see.

I've checked the dates in the RRA files with: rrdtool dump and they are not being updated since yesterday. I've also made sure the date on the system running cacti was correct.

Any one have a cluebat?

Thanks,

E

[gandalf]

Please check file sizes and disk space usage. Rerun the command without piping output to cacti.log and report your findings

Reinhard

[eegilbert]

Hi Reinhard,

The disk space looks OK:

Filesystem Size Used Avail Use% Mounted on
/dev/cciss/c0d0p2 33G 12G 22G 36% /
tmpfs 1.4G 12K 1.4G 1% /dev/shm
/dev/cciss/c0d1p1 34G 27G 7.8G 78% /var
/dev/cciss/c0d2p1 34G 33M 34G 1% /data
mrburns /vol/vol1
240G 76G 165G 32% /mnt/netapp

The cacti log file is only 3MB, I'll check the forum to see if this is bumping up against a limit:
scratchy:/var/www/htdocs/cacti/log # ls -lah
total 9.1M
drwxr-xr-x 2 wwwrun users 112 Sep 21 11:56 .
drwxr-xr-x 12 erric users 1.7K Sep 20 19:21 ..
-rw-r--r-- 1 wwwrun root 3.0M Sep 25 07:37 cacti.log
-rw-r--r-- 1 wwwrun users 6.1M Sep 20 12:15 cacti.log.gz

Updates will follow. Thanks for the assistance.

[eegilbert]

Reinhard, if I run the command without piping to a file I get the same results:

cacti@scratchy:~> /usr/bin/php /srv/www/htdocs/cacti/poller.php
09/25/2006 08:54:19 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/local/cactid/bin/cactid, ARGS: 0 146]
Waiting on 1/1 pollers.

[gandalf]

The, please run cactid manually, e.g.

Code: Select all

cactid --verbosity=5 0 5

assunming there are hosts with id 0..5, respectively
Reinhard

[fabio]

Hi eegilbert,

the same thing just happened to my cacti testbed installation.

After beating about the bush for quite a while, I had the feeling that having a cacti.log file with a 2GB size wasn't good at all, even though I had also checked out if it could be a disk space problem (apparently it wasn't), but after several actions trying to regenerate the poller cache without success I finally deleted and created it again.

Code: Select all

/var/www/html/cacti/log/rm cacti.log
/var/www/html/cacti/log/touch cacti.log

I don't know exactly how, but it worked, maybe Reinhard will know why this solved the issue because I am curious about it and don't want this problem to happen again.

Hope this help you to recover your installation too!

Best regards,

Fabian.

[eegilbert]

Thanks all for the suggestions, but I ended up just starting over. I have the rra files should I need to look up historical data but I just don't have the time to trouble shoot anymore.