graph data is no longer updated, everything else works

[jclux0r]

I moved my working cacti installation from a 32-bit ubuntu 9.04 machine to a 64-bit machine with the same OS.

I exported(32-bit) and imported(64-bit) the rrd files, and dumped the mysql database over. The cacti user interface has all my settings correctly, I can successfully change preference settings, and all the entries for my machines are there. I have also successfully added a new device since the move. That leads me to believe the database connection is functioning both for reads and writes.

In addition, all the graph data from before the move is displayed correctly.

However, graph data is no longer being updated for any of the devices.

When I turn on poller debug mode, I see snmp data being read correctly, but I don't see any mention of rrdtool updates, and all the rrd files have time stamps from before the move. The poller_output table in the mysql database has updated data as well.

I have tried clearing the poller cache, and spot checks of the rrd files show reasonable data as well as reasonable max and min values.

Any ideas?

Thanks much!

[jclux0r]

BTW, this is cacti-0.8.7e.

[gandalf]

The updates will show up in debug mode only.
You may pipe cron output for poller into some log file to get more information.
R.

[jclux0r]

The updates will show up in debug mode only.
You may pipe cron output for poller into some log file to get more information.
R.

I am using poller debug mode and I see all the snmp data being fetched, but

I have also tried cactid to no avail.

Since I posted, I've tried running poller_output_empty.php which ran for a period of time and seemed to fill in some more data, but it has continued to run for about two hours since then without filling in any more data, and doesn't seem to ever to terminate.

[jclux0r]

One more datapoint:

I took the following steps:

1. Manually cleared the poller_output table in mysql.

2. I disabled two hosts (of about 50) which weren't working (because they're down).

3. Manually ran the poller, which still fails to update the graphs, but which populated the poller_output table in mysql.

4. Manually ran poller_output_empty.php which empties the poller_output table and updates all the graphs!

Any idea why it's not doing this as part of the poller?

[gandalf]

BTW, this is cacti-0.8.7e.

And then you're running cactid instead of spine?
R.

[jclux0r]

BTW, this is cacti-0.8.7e.

And then you're running cactid instead of spine?
R.

I tried using cactid briefly after I couldn't get the standard poller to work right, but the description I gave in this thread is mostly the standard poller.

[gandalf]

Then please use the advise from above. Change the cronatb entry not to pipe poller.php output to /dev/null but e.g. to /tmp/poller.log
See what this file has for you
R.

[jclux0r]

Then please use the advise from above. Change the cronatb entry not to pipe poller.php output to /dev/null but e.g. to /tmp/poller.log
See what this file has for you
R.

I've seen this output several times because of running the poller manually. I don't see any obvious errors. I see a bunch of snmp queries (and a few script runs). I still don't see any rrdtool updates. It says this at the end:

10/30/2009 12:15:35 PM - CMDPHP: Poller[0] Time: 46.0210 s, Theads: N/A, Hosts: 43

If I run the poller graphs aren't updated. If I then run poller_output_empty.php, the graphs get updated.

Can you think of a reason the poller would be failing to do this step?

[gandalf]

Can you think of a reason the poller would be failing to do this step?

No; else I would have suggested differently. First time this issue appears for me. Online session would be required
R.

[JoelKatz]

I had a similar problem after I did some manual manipulation of my RRDs. I was sure I had screwed them up, and in a sense, I had.

The problem was the permissions on the RRDs were such that Cacti could not modify them! Facepalm!

Maybe you did the same thing? What's the 'last update' field of your RRDs? (You can get it from 'rrdtool dump'.)

[roanitop]

I've just had apparently the same problem, I had this problem solved, recraiting the table pooller_output.

I did cause i've tried to repair the cacti database, then i notice that this table was corrupted or something like this.


DROP TABLE IF EXISTS `poller_output`;
SET @saved_cs_client = @@character_set_client;
SET character_set_client = utf8;
CREATE TABLE `poller_output` (
`local_data_id` mediumint(8) unsigned NOT NULL default '0',
`rrd_name` varchar(19) NOT NULL default '',
`time` datetime NOT NULL default '0000-00-00 00:00:00',
`output` text NOT NULL,
PRIMARY KEY (`local_data_id`,`rrd_name`,`time`)
) TYPE=MyISAM;
SET character_set_client = @saved_cs_client;

--
-- Dumping data for table `poller_output`
--

LOCK TABLES `poller_output` WRITE;
/*!40000 ALTER TABLE `poller_output` DISABLE KEYS */;
/*!40000 ALTER TABLE `poller_output` ENABLE KEYS */;
UNLOCK TABLES;

[jclux0r]

Can you think of a reason the poller would be failing to do this step?

No; else I would have suggested differently. First time this issue appears for me. Online session would be required
R.

OK, so I just completely blew away my cacti installation. Totally blew away the database and recreated it. Fresh cacti install from the .tar file I downloaded from the cacti site.

Exactly the same thing is happening.

poller.php runs, collects all the data (now with only two hosts -- new install), puts it in the poller_output table of the cacti database, and then doesn't update the rrd files.

if I run poller_output_empty.php it updates the rrd files.

Any ideas?

[jclux0r]

[quote="roanitop"]I've just had apparently the same problem, I had this problem solved, recraiting the table pooller_output.

Thanks for the suggestion, but I deleted the database and recreated it with a fresh cacti install and it still does the same thing.

[jclux0r]

I had a similar problem after I did some manual manipulation of my RRDs. I was sure I had screwed them up, and in a sense, I had.

The problem was the permissions on the RRDs were such that Cacti could not modify them! Facepalm!

Maybe you did the same thing? What's the 'last update' field of your RRDs? (You can get it from 'rrdtool dump'.)

If you noticed in my post above, I mentioned that I was able to get the rrd files to update by running poller_output_empty.php manually.