Waiting on 1/1 pollers.

[thomasN]

After I started running cactid to a remote database I could see that the poller.php never ended.

11/17/2004 11:09:56 AM - POLLER: Poller[0] Maximum runtime of 296 seconds exceeded. Exiting.

However, the actual polling is done a long time ago according to the log:

11/17/2004 11:05:54 AM - PHPSVR: Poller[0] DEBUG: PHP Script Server Shutdown request received, exiting
11/17/2004 11:05:54 AM - CACTID: Poller[0] Time: 53.2327 s, Threads: 5, Hosts: 136

When not redirecting output from poller.php to /dev/null I could see this:

Waiting on 1/1 pollers.
Waiting on 1/1 pollers.
Waiting on 1/1 pollers.
Waiting on 1/1 pollers.
Waiting on 1/1 pollers.
Waiting on 1/1 pollers.

...

I ran a truss(1) on the php-process, output is attached.

Why doesn't cactid exit?

[TheWitness]

What version of Cacti, what version of Cactid?

[thomasN]

cacti 0.8.6b and cactid 0.8.6c. Both release-versions (not cvs).

[rony]

Is cacti 0.8.5b patched with all the patches from:

http://www.cacti.net/downloads/patches/0.8.6b/

[TheWitness]

What version of PHP are your running? Is it CLI or CGI.

Thanks,

TheWitness

[thomasN]

php4-4.3.9

cli or cgi? I have a /usr/local/bin/php binary if that's what you mean.

[TheWitness]

Run "php -v" and post the results.

Larry

[TheWitness]

Run "php -v" and post the results.

Larry

[thomasN]

# php -v
PHP 4.3.9 (cli) (built: Oct 15 2004 11:54:56)
Copyright (c) 1997-2004 The PHP Group
Zend Engine v1.3.0, Copyright (c) 1998-2004 Zend Technologies

I also just noted that the rrd's are not beeing updated anymore. I switched back to running in the local database and now that doesn't work either. Yiikes..

[thomasN]

In the SQL-server, I can see this query beeing repeated for every time the Waiting for 1/1 poller message

041118 13:10:54 7 Query select poller_id,end_time from poller_time where poller_id = 0
7 Query select
poller_output.output,
poller_output.time,
poller_output.local_data_id,
poller_item.rrd_path,
poller_item.rrd_name,
poller_item.rrd_num
from poller_output,poller_item
where (poller_output.local_data_id=poller_item.local_data_id and poller_output.rrd_name=poller_item.rrd_name)
041118 13:10:55 7 Query select poller_id,end_time from poller_time where poller_id = 0
7 Query select
poller_output.output,
poller_output.time,
poller_output.local_data_id,
poller_item.rrd_path,
poller_item.rrd_name,
poller_item.rrd_num
from poller_output,poller_item
where (poller_output.local_data_id=poller_item.local_data_id and poller_output.rrd_name=poller_item.rrd_name)
041118 13:10:57 7 Query select poller_id,end_time from poller_time where poller_id = 0
7 Query select
poller_output.output,
poller_output.time,
poller_output.local_data_id,
poller_item.rrd_path,
poller_item.rrd_name,
poller_item.rrd_num
from poller_output,poller_item
where (poller_output.local_data_id=poller_item.local_data_id and poller_output.rrd_name=poller_item.rrd_name)
041118 13:10:58 7 Query select poller_id,end_time from poller_time where poller_id = 0
7 Query select
poller_output.output,
poller_output.time,
poller_output.local_data_id,
poller_item.rrd_path,
poller_item.rrd_name,
poller_item.rrd_num
from poller_output,poller_item
where (poller_output.local_data_id=poller_item.local_data_id and poller_output.rrd_name=poller_item.rrd_name)

[thomasN]

Is cacti 0.8.5b patched with all the patches from:

http://www.cacti.net/downloads/patches/0.8.6b/

Now, yes, no change.

[TheWitness]

Can you try running with cmd.php. Before you do so though, you need to truncate the poller_output table to prevent your system from overflowing.

So, first check the number of rows in poller_output, post it. Then truncate table poller_output. Then use cmd.php with say 8 concurrent processes to get your polling running again.

After that, let's talk updating cactid. We found yet another problem that may be causing your problems.

TheWitness

[thomasN]

My poller_output has no data at all.

mysql> select * from poller_output;
Empty set (0.00 sec)

mysql> DESCRIBE poller_output;
+---------------+-----------------------+------+-----+---------------------+-------+
| Field | Type | Null | Key | Default | Extra |
+---------------+-----------------------+------+-----+---------------------+-------+
| local_data_id | mediumint(8) unsigned | | PRI | 0 | |
| rrd_name | varchar(19) | | PRI | | |
| time | datetime | | PRI | 0000-00-00 00:00:00 | |
| output | text | | | | |
+---------------+-----------------------+------+-----+---------------------+-------+
4 rows in set (0.00 sec)

So I guess no truncate will be neccecary?

[thomasN]

When running cmd.php the graphs are beeing updated but it doesn't even come close to getting through all objects (maximum execution time).

I modified MAX_POLLER_RUNTIME to a high value and let the script run. I can see rrds update and also mysql activity.

In the graphs now 'nan' is displayed. I can also confirm this with 'rrdtool fetch xxx.rrd AVERAGE'.

I tried switching back to cactid but same problem as before, I can see a loop if I run php thorugh truss and I can see the same queries on the mysql activity log.

Will try latest cactid from cvs later on today...

Edit: Can I run latest cactid? I remember reading about not beeing compatible with 0.8.6b but only with 0.8.7x.

[TheWitness]

Thomas,

You will find attached a small change to cactid. Remake the file and see if it corrects your problem.

TheWitness