Maximum runtime of 58 seconds exceeded. How optimize?

[L0gRuS]

Hi.
I have around 750 device in cacti. Sometimes in log i look this message "Maximum runtime of 58 seconds exceeded. Exiting".
This mean what poller cant received all oid in one minute, and then on graphs create empty zone.
I want monitoring my device every minute. How i can optimize cacti?



normal polling

03/31/2011 01:11:32 PM - SYSTEM STATS: Time:30.5963 Method:spine Processes:6 Threads:6 Hosts:652 HostsPerProcess:109 DataSources:12708 RRDsProcessed:7216

cacti information

Date Thu, 31 Mar 2011 13:18:57 +0400
Cacti Version 0.8.7g
Cacti OS unix
SNMP Version NET-SNMP version: 5.3.2.2
RRDTool Version RRDTool 1.2.x
Hosts 751
Graphs 6426
Data Sources Script/Command: 9
SNMP: 1755
SNMP Query: 5537
Script Query: 2
Script - Script Server (PHP): 5
Total: 7308
Poller Information
Interval 60
Type spine
Items Action[0]: 12693
Action[1]: 13
Action[2]: 5
Total: 12711
Concurrent Processes 6
Max Threads 6
PHP Servers 8
Script Timeout 25
Max OID 50
Last Run Statistics Time:193.8062 Method:spine Processes:6 Threads:6 Hosts:652 HostsPerProcess:109 DataSources:12704 RRDsProcessed:7120
PHP Information
PHP Version 5.1.6
PHP OS Linux
PHP uname Linux cacti 2.6.18-194.32.1.el5 #1 SMP Wed Jan 5 17:53:09 EST 2011 i686
PHP SNMP Installed
max_execution_time 30
memory_limit 300M

[hmorandell]

I have a similar installation to yours with some more hosts, try changning the following parameters in php.ini:

from your current settings:

max_execution_time 30
memory_limit 300M

to

max_execution_time 60
memory_limit 512M

or depending on memory give even more! But how often does the script go in timeout? Maybe you have loads of devices over slow links which takes ages to respond to snmp queries?

[hmorandell]

P.S.:

I forgot:

try changing:

Max Threads 6

to:

Max Threads 30

[L0gRuS]

i add 6gb RAM to server, change kernel to PAE, and install boost plugin and modify mysql config. after two hours all works perfect.

[mysqld]
max_allowed_packet=32M
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
user=mysql
old_passwords=1
key_buffer= 1024M
max_heap_table_size=2048MB

set-variable = thread_concurrency=2

[mysqld_safe]
log-error=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid

[mysqldump]
quick
set-variable = max_allowed_packet=16M

[isamchk]
set-variable = key_buffer=512M
set-variable = sort_buffer=512M
set-variable = read_buffer=4M
set-variable = write_buffer=4M

normap poller log

03/31/2011 07:15:31 PM - SYSTEM STATS: Time:29.4031 Method:spine Processes:6 Threads:6 Hosts:744 HostsPerProcess:124 DataSources:12707 RRDsProcessed:0



but sometimes in logs i look next message

3/31/2011 07:09:22 PM - PHPSVR: Poller[0] WARNING: Script Server terminated with signal '15' in file:'', function:'', params:''
03/31/2011 07:09:21 PM - PHPSVR: Poller[0] WARNING: Script Server terminated with signal '15' in file:'', function:'', params:''
03/31/2011 07:09:21 PM - PHPSVR: Poller[0] WARNING: Script Server terminated with signal '15' in file:'ss_poller.php', function:'ss_recache', params:''
03/31/2011 07:09:21 PM - PHPSVR: Poller[0] WARNING: Script Server terminated with signal '15' in file:'ss_poller.php', function:'ss_poller', params:''

if all will works after one day i think what optimize is complete.



after 8 hours.

all works.
The topic can be closed.