Cactid processes climbing and gaps in graphs

[lard]

Hello,

I have an issue on a cacti server with Cactid (version f) where I will see approx 20/30 instances of cactid.exe running on the server without dissappearing.

I am also showing gaps in multiple graphs at varying intervals but at the same time on all devices,

Is their any logging I can enable for Cactid to look into this problem??

Thanks,

Larry

[lard]

Sorry- Versions:

Cactid 0.8.6f
Cacti 0.8.6g
Windows 2000

Thanks,

Larry

[lard]

Just to add - the gaps in the graphs I have a feeling are network related - it's more the processes that is concerning me?

Any info needed then let me know,

Thanks,

Larry

[lard]

The following error is appearing quite often in the cacti log file:

11/28/2005 12:03:07 PM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating


Any one had any experience of this one?

Thanks,

Larry

[lard]

Attachment shows the processes on the desktop of the server - as expected these are all listed as "cactiplus"

Thinking on this...their is a way to stop processes interacting with the desktop on windows - may help!

Thanks,

Larry

[wvr120364]

Larry,

I have the same with cacti 8.6g with the php-poller running. I tried to set a maximum time for scheduled task, but that was no help. The only way for me was to kill all cmd processes by hand.

A question, did you have mbm5 installed? When I stop polling mbm5 it all looks good.

Wietze

[lard]

Hello,

Just had a google to see what mbm5 was

But no - I don't use mbm5 for polling but I am wondering about the phpserver error I am getting in the log files - could it be that your mbm5 monitoring was via a php script that was faulty? - If this is the case then it would make sense that we both have an issue and this is down to scripts,

One change I made was to increase the timeout within php.ini to get data from some slow responding cisco switches - is this something you changed?

Thanks,

Larry

[TheWitness]

lard,

It is likely the PHP server error that is causing your issues. Please post your cygwin version installed (if at all).

When the PHP Script Server issues an Input Expected, Script Server Terminating, it is due to a Cactid segfault. Not a good thing. That version of Cactid has been pretty stable. I have a newer version of Cactid out on the web site that may provide happieness. However, before you go there, I would like some information:

PHP Version?
CGI or CLI?
Windows Version?
Cygwin1.dll Version?
Net-SNMP Version?
Did you Make Cactid or Download?
Are you using the Script Server. You can tell by Running Cactid in DEBUG for 1 pass and posting the DEBUG log.

TheWitness

[BSOD2600]

Isn't cactiplus used for exporting?

Do you have exporting enabled in cacti?

[lard]

Hello Guys,

In response to the cactiplus query - Graph export is currently set to disabled,

The versions requested are as follows:

PHP version 5.0.4
Not too sure what you mean by CGI or CLI?
Windows 200 Server SP4
I installed complete cygwin app - version 2.510.2.2 if this helps
Net-SNMP version 5.2.1-1
I downloaded the cactid pre-compiled

Any more info needed then let me know - finally the debug log is as below - this is only a section of it as when it made one pass under DEBUG the log was pver 2Mb - if you need the entire thing then let me know - I have included the starting section and also a section that shows the error

Many thanks,

Lard


11/29/2005 05:46:59 PM - CACTID: Poller[0] DEBUG: SQLCMD: update host set status='3',status_event_count='0', status_fail_date='2005-11-29 12:03:00',status_rec_date='0000-00-00 00:00:00',status_last_error='Host did not respond to SNMP',min_time='0.000000',max_time='999.999990',cur_time='0.999930',avg_time='13.852200',total_polls='30651',failed_polls='37',availability='99.8793' where id='3'
11/29/2005 05:46:59 PM - CACTID: Poller[0] Host[3] SNMP Result: Host responded to SNMP
11/29/2005 05:46:59 PM - CACTID: Poller[0] MYSQL: Connected to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:59 PM - CACTID: Poller[0] DEBUG: The Value of Active Threads is 2
11/29/2005 05:46:59 PM - CACTID: Poller[0] MYSQL: Connecting to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:59 PM - CACTID: Poller[0] DEBUG: Valid Thread to be Created
11/29/2005 05:46:59 PM - CACTID: Poller[0] DEBUG: In Poller, About to Start Polling of Host
11/29/2005 05:46:58 PM - CACTID: Poller[0] Host[0] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
11/29/2005 05:46:58 PM - CACTID: Poller[0] MYSQL: Connected to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The Value of Active Threads is 1
11/29/2005 05:46:58 PM - CACTID: Poller[0] MYSQL: Connecting to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: Valid Thread to be Created
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: In Poller, About to Start Polling of Host
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: Initial Value of Active Threads is 0
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: Parent pid=9368, Script Server pid=4180
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: PHP Script Server Child FORK Success
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: Confirmed PHP Script Server Running.
11/29/2005 05:46:58 PM - PHPSVR: Poller[0] PHP Script Server has Started - Parent is cactid
11/29/2005 05:46:58 PM - PHPSVR: Poller[0] DEBUG: FILENM: e:\Apache2\htdocs\cacti\script_server.php
11/29/2005 05:46:58 PM - PHPSVR: Poller[0] DEBUG: DIRNAM: e:/apache2/htdocs/cacti
11/29/2005 05:46:58 PM - PHPSVR: Poller[0] DEBUG: GETCWD: e:/cactid
11/29/2005 05:46:58 PM - PHPSVR: Poller[0] DEBUG: SERVER: cactid
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: PHP Script Server Child FORK Success
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: PHP Script Server About to FORK Child Process
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: PHP Script Server Routine Starting
11/29/2005 05:46:58 PM - CACTID: Poller[0] CACTID: Initializing PHP Script Server
11/29/2005 05:46:58 PM - CACTID: Poller[0] CACTID: Initializing Net-SNMP API
11/29/2005 05:46:58 PM - CACTID: Poller[0] MYSQL: Connected to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:58 PM - CACTID: Poller[0] MYSQL: Connecting to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:58 PM - CACTID: Poller[0] CACTID: Version 0.8.6f starting
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The Maximum SNMP OID Get Size is 10
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The PHP Script Server is Required
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: StartHost='0', EndHost='212', TotalPHPScripts='21'
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The script timeout is 25
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The number of concurrent processes is 1
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The polling interval is the system default
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The threads variable is 10
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The log_pstats variable is 1
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The log_pwarn variable is 0
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The log_perror variable is 0
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The ping_timeout variable is 400
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The ping_retries variable is 1
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The ping_method variable is 1
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The ping_failure_count variable is 2
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The ping_recovery_count variable is 3
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The availability_method variable is 2
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The path_php variable is e:/php/php-win.exe
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The log_destination variable is 1
11/29/2005 05:46:58 PM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: e:\cactid\cactid.exe, ARGS: 0 212]


And error:

1133286418:73373153
11/29/2005 05:47:04 PM - POLLER: Poller[0] CACTI2RRD: E:\rrdtool/rrdtool.exe update E:\Apache2\htdocs\cacti\rra\roleeds01_sysuptime_212.rrd --template sysUpTime 1133286418:69893930
11/29/2005 05:47:04 PM - POLLER: Poller[0] CACTI2RRD: E:\rrdtool/rrdtool.exe update E:\Apache2\htdocs\cacti\rra\roleeds01_traffic_in_213.rrd --template traffic_in:traffic_out 1133286418:897752096:414315242
11/29/2005 05:47:04 PM - POLLER: Poller[0] CACTI2RRD: E:\rrdtool/rrdtool.exe update E:\Apache2\htdocs\cacti\rra\roleeds01_traffic_in_214.rrd --template traffic_in:traffic_out 1133286418:351033370:827244799
11/29/2005 05:47:04 PM - POLLER: Poller[0] CACTI2RRD: E:\rrdtool/rrdtool.exe update E:\Apache2\htdocs\cacti\rra\roleeds01_traffic_in_215.rrd --template traffic_in:traffic_out 1133286418:0:0
11/29/2005 05:47:04 PM - POLLER: Poller[0] CACTI2RRD: E:\rrdtool/rrdtool.exe update E:\Apache2\htdocs\cacti\rra\roleeds01_5min_cpu_211.rrd --template 5min_cpu 1133286418:5
11/29/2005 05:47:06 PM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating
11/29/2005 05:47:06 PM - SYSTEM STATS: Time:8.7452 Method:cactid Processes:1 Threads:10 Hosts:168 HostsPerProcess:168 DataSources:6512 RRDsProcessed:219
11/29/2005

[lard]

Isn't cactiplus used for exporting?

Do you have exporting enabled in cacti?

Hello,

Just checked on our other Cacti server and it also launches two DOS prompts when Cacti polls - one called "cactiplus" and the other is cmd.exe,

This only happened since the new version was installed but is the same on both servers - before it would just launch two cmd.exe's

Thanks,

Lard

[TheWitness]

Cactiplus is the name for all poller driven started tasks. The dos command is a nasty side effect because of Windows. It needs a operating environment and that is initialized by a cmd.exe. This is all normal whether it's a cmd.php, part of cactid, poller reindexing, poller_command, or poller_export.

Please see my post under announcements. I want people to test this new version.

TheWitness

[lard]

Hi Witness,

If you have a new version out then it makes sense to can this post and re-visit if it is still a problem in the later version of cactid,

As mentioned - only one of our two cacti servers is having this issue so I am not certain that I could recreate my problem cacti server on a test platform and try the beta cactid - if I manage to recreate it I'll put on the Beta Cactid - failing that I'll wait for it to go mainstream and upgrade to cure this problem!

Thanks for looking into this,

Lard

[gandalf]

Moved to Win32 Specific
Reinhard

[TheWitness]

What is likely happening is that your php script server scripts are hanging. What script server scripts do you currently run?

TheWitness