HELP - all graphs stopped updating 5am last Friday ...

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

Post Reply
pcorchary
Posts: 39
Joined: Wed Apr 20, 2005 4:20 pm
Location: Denver Colorado USA
Contact:
Contact pcorchary

HELP - all graphs stopped updating 5am last Friday ...

Post by pcorchary »

And I have no idea where to begin. /var did fill up at one point, fixed and the box completely rebooted and all filesystems OK and cacti processes OK.... and snmpget's from the command line to some hosts work, so there isn't any firewall, network or snmp daemon change creating this. I'm screwed ... I have about the first 200 of the 2000 total servers in Cacti, and i need the data for capacity planning! :-)

these files in /var/db/mysql/cacti are being updated to current date...

...
-rw-rw---- 1 mysql mysql 0 May 17 15:10 poller_time.MYD
-rw-rw---- 1 mysql mysql 1736 May 17 15:10 settings.MYD
-rw-rw---- 1 mysql mysql 1024 May 17 15:10 poller_time.MYI
-rw-rw---- 1 mysql mysql 4096 May 17 15:10 settings.MYI
-rw-rw---- 1 mysql mysql 21472 May 17 15:13 host.MYD
-rw-rw---- 1 mysql mysql 16008 May 17 15:13 poller_reindex.MYD
-rw-rw---- 1 mysql mysql 22144000 May 17 15:13 poller_output.MYI
-rw-rw---- 1 mysql mysql 51256568 May 17 15:13 poller_output.MYD

and procs are running

# ps -aux | grep cacti
root 92909 0.0 0.1 1472 1156 p0 RV+ 3:14PM 0:00.00 grep cacti (csh)
root 88824 0.0 1.2 14800 12544 ?? S 3:10PM 0:02.20 /usr/local/bin/php -q /usr/local/www/data-dist/cacti/cmd.php 0 170
root 88827 0.0 0.0 636 440 ?? I 3:10PM 0:00.01 sh -c /usr/local/bin/php /usr/local/www/data-dist/cacti/script_server.php cmd
root 88828 0.0 0.6 8556 6232 ?? I 3:10PM 0:00.12 /usr/local/bin/php /usr/local/www/data-dist/cacti/script_server.php cmd
root 92904 0.0 0.0 640 444 ?? S 3:14PM 0:00.00 sh -c /usr/local/bin/php -q /usr/local/www/data-dist/cacti/scripts/query_host_partitions.php b
root 92905 0.0 0.6 8640 6300 ?? S 3:14PM 0:00.12 /usr/local/bin/php -q /usr/local/www/data-dist/cacti/scripts/query_host_partitions.php blisweb
dco2#


:cry:
Top
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:
Contact rony

Post by rony »

How big is your log file... If it large, zero it out and see if that helps.
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
Top
pcorchary
Posts: 39
Joined: Wed Apr 20, 2005 4:20 pm
Location: Denver Colorado USA
Contact:
Contact pcorchary

Post by pcorchary »

not very big ...
# ll
total 8160
-rw-r--r-- 1 root wheel 7913707 May 20 12:45 cacti.log
-rw-r--r-- 1 root wheel 392440 May 17 14:33 cacti.log-bk.gz

the MySQL table-files are still updating as current, but the RRD files have not been updated since 5/13 at 9:44!


:cry:
Top
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:
Contact rony

Post by rony »

Post a debug run of you poller.
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
Top
pcorchary
Posts: 39
Joined: Wed Apr 20, 2005 4:20 pm
Location: Denver Colorado USA
Contact:
Contact pcorchary

Post by pcorchary »

clean from what I can see...

FYI, I'm taking over this cacti install from another fellow, and also need to migrate to a new box (from BSD to Linux). My personal background is 20 years of unix and network admin; some snmp; very little rrd or mysql previous, just so you know where I'm coming from.

05/20/2005 01:00:00 PM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/local/bin/php, ARGS: -q /usr/local/www/data-dist/cacti/cmd.php 0 174]
05/20/2005 01:00:01 PM - PHPSVR: Poller[0] DEBUG: SERVER: cmd
05/20/2005 01:00:01 PM - PHPSVR: Poller[0] DEBUG: GETCWD: /root
05/20/2005 01:00:01 PM - PHPSVR: Poller[0] DEBUG: DIRNAM: /usr/local/www/data-dist/cacti
05/20/2005 01:00:01 PM - PHPSVR: Poller[0] DEBUG: FILENM: /usr/local/www/data-dist/cacti/script_server.php
05/20/2005 01:00:17 PM - PHPSVR: Poller[0] DEBUG: PHP Script Server Shutdown request received, exiting
Top
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:
Contact rony

Post by rony »

That is not the whole log.....

Please make sure that poller.php is being called from cron.

Also, in the cacti web interface, please set your "Poller Logging Level" to Debug and post one round fo the poller running.
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
Top
cooper
Posts: 1
Joined: Fri May 20, 2005 3:22 pm
Contact:
Contact cooper

Post by cooper »

Rony, thanks for all your help so far. Shoot me a PM or yahoo message so I can show you the debug output.
Top
pcorchary
Posts: 39
Joined: Wed Apr 20, 2005 4:20 pm
Location: Denver Colorado USA
Contact:
Contact pcorchary

Post by pcorchary »

Or me too ... I can show you as well.
Top
Post Reply

Return to “Help: General”

Who is online

Users browsing this forum: No registered users and 1 guest