Cactid Errors [NOT solved]

[Cacti Jack]

CACTID: Poller[0] Host[63] ERROR: The POPEN timed out

and

CACTID: Poller[0] ERROR: SS[999] Script Server did not start properly return message was: 'U'

and

10 [unknown (0xD88)] cactid 3168 sig_send: wait for sig_complete event failed, signal -34, rc 258, Win32 error 0

Server: Cacti 0.8.6j |Win 2003 MySQL 5.0.37| PHP 5.2.2 | RRDtool 1.2.19| BOOST 1.3 | Cactid 0.8.6j|

[Cacti Jack]

A bigger problem is sometimes my poller completes in 30 seconds, other times it does not; often leaving running many cactid.exe, php.exe, and an sh.exe process running that do not end. At the next poll cycle more procs are added and eventually the server is overloaded from out of control process load.

This is causing my poller to hang, and gaps to appear in my graphs ... It's quite a mess.

[gandalf]

You already paid attention to the php memory settings?
Reinhard

[Cacti Jack]

You already paid attention to the php memory settings?
Reinhard

memory_limit = 256M

[mcutting]

A bigger problem is sometimes my poller completes in 30 seconds, other times it does not; often leaving running many cactid.exe, php.exe, and an sh.exe process running that do not end. At the next poll cycle more procs are added and eventually the server is overloaded from out of control process load.

This is causing my poller to hang, and gaps to appear in my graphs ... It's quite a mess.

I had exactly the same problem. For me, the poller would hang more often than not, with runaway sh.exe and cactid.exe processes. In the end, I went for cactid version G, which does not use sh.exe.

This solved the problem of the poller hanging, although it takes about 5 or 6 seconds before data begins to be collected. All of the MIBS are present, and I'm not using MIBS=All. If I could reduce this delay, or prevent it fully, my poller would probably complete in about 20 seconds or less.

Just noticed that you are using PHP 5.2.2. Have you replaced the libmysql.dll with one from PHP 5.2.0, as this is a known bug - see http://bugs.php.net/bug.php?id=41350

[Cacti Jack]

I had exactly the same problem. For me, the poller would hang more often than not, with runaway sh.exe and cactid.exe processes. In the end, I went for cactid version G, which does not use sh.exe.

I tried version g of cactid; but there is no change.

Just noticed that you are using PHP 5.2.2. Have you replaced the libmysql.dll with one from PHP 5.2.0, as this is a known bug - see http://bugs.php.net/bug.php?id=41350

yes i was using the 5.2.0 library. Just to test if it's related to my version of PHP; I've sent reverted my php back to 5.2.0; and still the same issue happens.

[mcutting]

When you say a debug poll from the command line, are you calling poller.php or CACTID.exe directly ?

[Cacti Jack]

When you say a debug poll from the command line, are you calling poller.php or CACTID.exe directly ?

I am calling the poller.php file.

[mcutting]

Ok. Do you see sh.exe (I am presuming you're running either H or I of CACTID) processes taking 99% CPU ?

[Cacti Jack]

Currently I am trying a process of elimination to solve this issue;

I first disabled every host I had, and ran the poller; it ran and worked polling no hosts, reporting the expected stats, and ending correctly.

I then proceeded slowly to add groups of hosts of slowly; and run the poller to see if it completed.


While doing this I did notice one thing;

(using 1 thread) in the window I start the poller it finishes and reports the stats; however the spawned new window it crates (named cactiplus) takes good 90 seconds to close after the poll has reported it has ran, while this is going on a rrdtool.exe process remains running and the window outputs a series of OKs, along with many ERRORs about expecting 4 datasources, got 1, etc.

Should I be concerned?

[Cacti Jack]

The more I run the poller; the more I've noticed my poller freezes at different places each time.

So something happens that causes the poller to hang, but I'm not sure what it is.

seems to happen on both cmd.php and cactid...

so maybe it's PHP related; what is considered the most stable php release for windows? what are some suggested php.ini settings I should validate/try?

[Cacti Jack]

Eh..

No matter what I change, cactid continues to crash with the following error at random times.

1401784 [unknown (0x1160)] cactid 5688 sig_send: wait for sig_complete event failed, signal -34, rc 258, Win32 error 0

[gandalf]

Please pm TheWitness, author of cactid
Reinhard

[TheWitness]

Cacti Jack,

Cygwin is somewhat, err, very problematic. I would suggest you do the following:

1) Install Cygwin from the distribution
2) Download the SVN Branch 0.8.6 of Cactid
3) Read the Windows make instructions
4) Perform the make. This requires you to make MySQL and Net-SNMP 5.1.x, no higher.
5) Install it use that version without any sh.exe or DLL's in your binary directory.

Post feedback once done.

TheWitness

[Cacti Jack]

Found solution.

Turns out it had nothing to do with cactid; my mysql tables were corrupted; this was causing cactid to crash.