RRA just stop being populated after last night

[vgjunkie]

For no reason last night, the graphing on my cacti install just stopped about 4:05AM (EST). I've was running cacti 0.8.6f-2 (??) but have since upgraded to the newest version.

I run the poller as cmd.php and a normal "System Stats" line would look like:

04:00:45 AM - SYSTEM STATS: Time:43.8689 Method:cmd.php Processes:7 Threads:N/A Hosts:124 HostsPerProcess:18 DataSources:9398 RRDsProcessed:3558

Even after the upgrade, I am still getting these messages in my cacti.log for every datasource:

04/18/2006 12:00:37 PM - CMDPHP: Poller[0] Host[24] DS[993] WARNING: Result from SNMP not valid. Partial Result:

Since 4:05AM EST no rra files have been updated either. (I assume this is due to cacti not getting any valid data from the SNMP). I can poll any one of these devices manually and get results.

I've cleared the poller cache and have put the log level to DEBUG and don't see anything out of the ordinary.

Any ideas on what to try next would be great.

I'm running FC4

Thanks.

-J

[vgjunkie]

I'm making some progress so far. I went in and disabled all the hosts except for one. This host updated fine, so I went in and enabled a page worth, and they all updated fine as well. I'm down to having about 20 hosts still disabled, and all rra files are updating for the "enabled" hosts at this point.

When/if I find the host that was causing the issue, I will post some log data regarding this host and maybe see what was causing it to make every other host fail.

[phrawzty]

When/if I find the host that was causing the issue, I will post some log data regarding this host and maybe see what was causing it to make every other host fail.

Any further progress on this? I'm curious to know what was causing the problem, and what the solution is...

[gandalf]

Please check /etc/php.ini memory settings. This should be at least 64MB

Code: Select all

;;;;;;;;;;;;;;;;;;;
; Resource Limits ;
;;;;;;;;;;;;;;;;;;;

max_execution_time = 30     ; Maximum execution time of each script, in seconds
max_input_time = 60     ; Maximum amount of time each script may spend parsing request data
;memory_limit = 8M      ; Maximum amount of memory a script may consume (8MB)
memory_limit = 64M      ; Maximum amount of memory a script may consume (64MB recommended for cacti)

Reinhard