After upgrade cacti/cactid - poller not processing all RRDs

[TheWitness]

You should run poller.php from a command line and see that you get all "OK"'s. Then, you should post your log file.

TheWitness

[Jeb]

I haven't it.
I have some plugin (weathermap/discovery/threshold/..) i will disable them just in case.
If i run poller.php manually i get lots of OK then stats and weathermap output.
I will redirect output to a file to see how many OK (line) i get

[Jeb]

Hum i get N Ok where N is the number of RRDsProcessed...
I have limited cactid to 1 process with 15 threads, i have the same bug but more rrd are processed...

[Jeb]

I'have looked at poller.php code, from what i see it just execute cactid and wait for the end. So i think the bug is in cactid, i'am wrong ?

[TheWitness]

Anything is possible, but Cactid does NOT process RRD's.

TheWitness

[Jeb]

Yes, from what i see cactid poll data, push them in poller_output and the php code update rrds, and delete data from poller_output.
I have stop my poller.php scheduled task, drop all data in poller_output and run poller.php 2 time manually. (with 1 process, 1 thread)

Here is what i get
11/19/2006 10:59:06 PM - SYSTEM STATS: Time:295.5380 Method:cactid Processes:1 Threads:1 Hosts:489 HostsPerProcess:489 DataSources:40374 RRDsProcessed:2361
11/19/2006 10:50:02 PM - SYSTEM STATS: Time:294.7411 Method:cactid Processes:1 Threads:1 Hosts:489 HostsPerProcess:489 DataSources:40374 RRDsProcessed:2415

and poller_output is empty at the end
I have the debug output but i haven't look at it for the moment.

after i switched to cmd.php and done the same test

11/20/2006 12:05:09 AM - SYSTEM STATS: Time:1009.9869 Method:cmd.php Processes:1 Threads:N/A Hosts:489 HostsPerProcess:489 DataSources:40374 RRDsProcessed:20620
11/19/2006 11:42:05 PM - SYSTEM STATS: Time:1016.8636 Method:cmd.php Processes:1 Threads:N/A Hosts:489 HostsPerProcess:489 DataSources:40374 RRDsProcessed:20917

There is still the bug but almost all my RRDs are processed...

[TheWitness]

Edit lib/poller.php and remove all evidence of the "LIMIT" from the code, or just make the variable that says "LIMIT 50000" equal to "" and see if that fixes it.

TheWitness

[Jeb]

for people having the same problem take a look to http://forums.cacti.net/viewtopic.php?p=84154

[allenelson]

i've learned that the number of RRD's will not match up with the number of data sources.

SYSTEM STATS: Time:1.0367 Method:cmd.php Processes:1 Threads:N/A Hosts:2 HostsPerProcess:2 DataSources:17 RRDsProcessed:13

that was bugging me for a long time and i thought something was wrong, where nothing is wrong but:

my interface eth0: 2 data sources, 1 graph
cpu usage: 3 data sources, 1 graph

etc etc

[XenoPhage]

Greetings,

I updated cacti from 0.8.6i to 0.8.6j and all but my local processing has stopped. I ran the poller by hand and I get this :

[xeno@local]$ sudo -u cactiuser php /var/www/html/cacti/poller.php
OK u:0.00 s:0.00 r:0.02
OK u:0.00 s:0.00 r:0.02
OK u:0.00 s:0.01 r:0.02
OK u:0.00 s:0.01 r:0.02
OK u:0.00 s:0.01 r:0.02
OK u:0.00 s:0.01 r:141.16
OK u:0.00 s:0.01 r:141.16
OK u:0.00 s:0.01 r:141.16
OK u:0.00 s:0.01 r:141.16
OK u:0.00 s:0.01 r:141.16
Content-type: text/html

02/28/2007 01:52:33 PM - POLLER: Poller[0] Maximum runtime of 292 seconds exceeded. Exiting.
02/28/2007 01:52:33 PM - SYSTEM STATS: Time:292.9289 Method:cmd.php Processes:1 Threads:N/A Hosts:10 HostsPerProcess:10 DataSources:335 RRDsProcessed:10
PHP Warning: pclose(): 45 is not a valid stream resource in /var/www/html/cacti/lib/rrd.php on line 48


If I downgrade to 0.8.6i, it begins working again. Any thoughts?

[gandalf]

Please try this one http://forums.cacti.net/viewtopic.php?t=19792
Reinhard

[wagnerluizrj]

People, I have the same problem: I have Cacti 0.8.6.j with Cactid 0.8.6.i and after I changed from cmd.php to cactid, It solves my time problem, but some RRDs are not processed creating holes in the graphic.

06/18/2007 04:53:12 PM - SYSTEM STATS: Time:191.0471 Method:cmd.php Processes:8 Threads:N/A Hosts:102 HostsPerProcess:13 DataSources:4590 RRDsProcessed:1478
06/18/2007 04:55:27 PM - SYSTEM STATS: Time:25.7602 Method:cactid Processes:8 Threads:25 Hosts:102 HostsPerProcess:13 DataSources:4590 RRDsProcessed:965
06/18/2007 05:00:26 PM - SYSTEM STATS: Time:24.7136 Method:cactid Processes:8 Threads:8 Hosts:102 HostsPerProcess:13 DataSources:4590 RRDsProcessed:965
06/18/2007 05:08:06 PM - SYSTEM STATS: Time:185.0632 Method:cmd.php Processes:8 Threads:N/A Hosts:102 HostsPerProcess:13 DataSources:4590 RRDsProcessed:1478
06/18/2007 05:13:26 PM - SYSTEM STATS: Time:203.9696 Method:cmd.php Processes:8 Threads:N/A Hosts:102 HostsPerProcess:13 DataSources:4590 RRDsProcessed:1478
06/18/2007 05:16:04 PM - SYSTEM STATS: Time:62.7150 Method:cactid Processes:8 Threads:1 Hosts:102 HostsPerProcess:13 DataSources:4590 RRDsProcessed:965
06/18/2007 05:20:31 PM - SYSTEM STATS: Time:29.6934 Method:cactid Processes:1 Threads:8 Hosts:102 HostsPerProcess:102 DataSources:4590 RRDsProcessed:965
06/18/2007 05:28:17 PM - SYSTEM STATS: Time:196.1263 Method:cmd.php Processes:8 Threads:N/A Hosts:102 HostsPerProcess:13 DataSources:4590 RRDsProcessed:1478
06/18/2007 05:33:17 PM - SYSTEM STATS: Time:195.0929 Method:cmd.php Processes:8 Threads:N/A Hosts:102 HostsPerProcess:13 DataSources:4590 RRDsProcessed:1478
06/18/2007 05:35:25 PM - SYSTEM STATS: Time:24.6948 Method:cactid Processes:8 Threads:8 Hosts:102 HostsPerProcess:13 DataSources:4590 RRDsProcessed:965.

Anybody can help me?

[gandalf]

First, please make sure to use fully patched cacti versions only, see http://www.cacti.net/download_patches.php
Then, please decide on further direction: Using cactid or cmd.php? Then lets dig deeper into any problems
Reinhard

[aleto]

Hi,

Currently im using a fully patched (PA 1.4 + cacti 0.8.7a + cmd.php) installation but its not updating my graphs anymore. Instead it just 'random' updates graphs;

e.g.:
11/20/2007 05:49:11 PM - SYSTEM STATS: Time:9.2329 Method:cmd.php Processes:1 Threads:N/A Hosts:37 HostsPerProcess:37 DataSources:137 RRDsProcessed:113

(I have about 500 RRDs)

When im using cacti 0.8.6j no problems at all.

Any ideas?

[TheWitness]

What is your poller interval? What is your cron interval?

TheWitness