POLLER: Poller[0] WARNING: Poller Output Table not Empty

[billylebegue]

Good morning,

I have two messages in my logs for some days now (hard to know the root cause)

04/02/2014 10:50:11 AM - POLLER: Poller[0] WARNING: Poller Output Table not Empty. Issues Found: 8286, Data Sources: cisco_memfree(DS[1502]), cisco_memused(DS[1503]), 5min_cpu(DS[1504]), traffic_in(DS[1505]), traffic_out(DS[1505]), traffic_in(DS[1506]), traffic_out(DS[1506]), traffic_in(DS[1507]), traffic_out(DS[1507]), traffic_in(DS[1508]), traffic_out(DS[1508]), traffic_in(DS[1509]), traffic_out(DS[1509]), traffic_in(DS[1510]), traffic_out(DS[1510]), traffic_in(DS[1511]), traffic_out(DS[1511]), traffic_in(DS[1512]), traffic_out(DS[1512]), traffic_in(DS[1513]), Additional Issues Remain. Only showing first 20

And :

POLLER: Poller[0] Maximum runtime of 298 seconds exceeded. Exiting.

Information on my system :
SPINE 0.8.7c
Cacti Version 0.8.8a

Code: Select all

cacti:/usr/local/spine/bin# cat /proc/cpuinfo | grep model | cut -c14-
Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz
Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz
Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz
Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz
Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz
Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz
Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz
Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz

I searched on this forum for hints and tried many things :
- raised memory limit in two files (didn't know which one was used) and reloaded apache2
/etc/php5/apache2/php.ini
/etc/php5/cli/php.ini

- Raised "Maximum Concurrent Poller Processes" from 6 to 10 (should be 2*number of cores, I think I'm still in the expected values)

- Raised "Maximum Threads per Process" from 15 to 20

- Raised "Script and Script Server Timeout Value" from 20 (no sure) to 30

- And finally run from the CLI "php -q poller_output_empty.php" which sometimes returns values like "OK u:0.24 s:0.58 r:152.02" (and between them I could catch "There were 10777, RRD updates made this pass")


Graphs are generated, but I sometimes have holes in them. RRDs seem to be processed.

04/02/2014 10:59:17 AM - SYSTEM THOLD STATS: Time:0.0309 Tholds:4 DownHosts:0
04/02/2014 10:59:08 AM - SYSTEM STATS: Time:47.0280 Method:spine Processes:10 Threads:20 Hosts:211 HostsPerProcess:22 DataSources:18288 RRDsProcessed:5182
04/02/2014 10:58:18 AM - SYSTEM THOLD STATS: Time:0.0340 Tholds:4 DownHosts:0
04/02/2014 10:58:14 AM - SYSTEM STATS: Time:55.3292 Method:spine Processes:10 Threads:20 Hosts:211 HostsPerProcess:22 DataSources:18288 RRDsProcessed:9466
04/02/2014 10:57:15 AM - SYSTEM STATS: Time:57.2279 Method:spine Processes:10 Threads:20 Hosts:211 HostsPerProcess:22 DataSources:18288 RRDsProcessed:9466
04/02/2014 10:56:14 AM - SYSTEM STATS: Time:72.0378 Method:spine Processes:10 Threads:20 Hosts:211 HostsPerProcess:22 DataSources:18288 RRDsProcessed:9466
04/02/2014 10:55:16 AM - SYSTEM THOLD STATS: Time:0.0326 Tholds:4 DownHosts:0
04/02/2014 10:55:03 AM - SYSTEM STATS: Time:37.9633 Method:spine Processes:10 Threads:20 Hosts:211 HostsPerProcess:22 DataSources:18286 RRDsProcessed:5180

What should I do to solve my issue ?

Thanks in advance for your help