Graphing randomly stopped working - error included

[Sonny]

Howdy - just started seeing an issue with the graphs failing to show any further data from 1:10am this morning. We are running v0.8.6f on Gentoo latest build/patches.

You can see from below that everything looked fine up until 1:10am. It says it cannot reach the device (10.0.50.1) but I can do a manual SNMP walk on it from that Linux box without any problems. I have also tried clearing the poller cache and even rebooted the server, but still receive the same errors below (they just repeat the same error every 5mins).

Any ideas?

09/13/2005 01:20:02 AM - SYSTEM STATS: Time: 1.0203 s, Method: cmd.php, Processes: 1, Threads: N/A, Hosts: 3, Hosts/Process: 3, Data Sources 13, RRDs Processed 9
09/13/2005 01:20:02 AM - CMDPHP: Poller[0] ASSERT: '429496700<429496700' failed. Recaching host '10.0.50.1', data query #1
09/13/2005 01:15:02 AM - RECACHE: Poller[0] STATS: Time: 0.6119 s, Hosts Recached: 1
09/13/2005 01:15:02 AM - POLLER: Poller[0] Host[2] WARNING: Recache Event Detected for Host
09/13/2005 01:15:02 AM - SYSTEM STATS: Time: 1.0190 s, Method: cmd.php, Processes: 1, Threads: N/A, Hosts: 3, Hosts/Process: 3, Data Sources 13, RRDs Processed 9
09/13/2005 01:15:01 AM - CMDPHP: Poller[0] ASSERT: '429496700<429496700' failed. Recaching host '10.0.50.1', data query #1
09/13/2005 01:10:03 AM - RECACHE: Poller[0] STATS: Time: 0.6994 s, Hosts Recached: 1
09/13/2005 01:10:02 AM - POLLER: Poller[0] Host[2] WARNING: Recache Event Detected for Host
09/13/2005 01:10:02 AM - SYSTEM STATS: Time: 1.0190 s, Method: cmd.php, Processes: 1, Threads: N/A, Hosts: 3, Hosts/Process: 3, Data Sources 13, RRDs Processed 9
09/13/2005 01:10:01 AM - CMDPHP: Poller[0] ASSERT: '429496700<429496700' failed. Recaching host '10.0.50.1', data query #1
09/13/2005 01:05:02 AM - SYSTEM STATS: Time: 1.0182 s, Method: cmd.php, Processes: 1, Threads: N/A, Hosts: 3, Hosts/Process: 3, Data Sources 13, RRDs Processed 9
09/13/2005 01:00:02 AM - SYSTEM STATS: Time: 1.0204 s, Method: cmd.php, Processes: 1, Threads: N/A, Hosts: 3, Hosts/Process: 3, Data Sources 13, RRDs Processed 9
09/13/2005 12:55:02 AM - SYSTEM STATS: Time: 1.0184 s, Method: cmd.php, Processes: 1, Threads: N/A, Hosts: 3, Hosts/Process: 3, Data Sources 13, RRDs Processed 9

[gandalf]

09/13/2005 01:15:01 AM - CMDPHP: Poller[0] ASSERT: '429496700<429496700' failed. Recaching host '10.0.50.1', data query #1

um,
some time ago there was an issue with some PIX firewalls not updating Sysuptime anymore. Please check, if sysuptime increments from walk to walk. Perhaps you're driving into that very same issue...
But even then I don't have the clue. But there was some post referring to systems not using sysuptime for snmp availabilty checks. Perhaps you'll find it there?
Reinhard

[Sonny]

Yep, thats what it turned out to be - PIX v 7.0(2) returns uptime of 49 days 17 hours but it never changes. I'll look for those topics you mention.

Cheers
Sonny

[Sonny]

Ok it's a known bug with Cisco PIX v7.x:

This is a known bug (CSCei20682), due to the time being stored in milliseconds in a 32-bit variable and 49 days 17 hours is where you hit the limit.

Already fixed in an upcoming 7.0 release, so keep checking the release notes here:

http://www.cisco.com/cgi-bin/tablebuild.pl/pix-interim

and you should see it listed. For the time being unfortunately you'll have to reboot the PIX to get the uptime back to normal.