RRDs do net get processed

Post support questions that directly relate to Linux/Unix operating systems.

Moderators: Developers, Moderators

Post Reply
theflow
Posts: 4
Joined: Fri Nov 18, 2005 5:10 am

RRDs do net get processed

Post by theflow »

Hey,

I constantly saw the poller.php running for a few days and on last sunday I killed it because I tought it was hung. Since then the graphs are empty and the RRDs are not updated (last modified time is exactly sunday at that time).

I didn't change anything since sunday and I triple checked permissions and settings. I've updated rrdtool, snmpd and cacti to the most recent versions (running on FreeBSD 4.11, php 4.4.0). I have no idea what could be wrong.

here is the output from running poller.php

Code: Select all

11/18/2005 11:10:03 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/local/bin/php, ARGS: -q /home/admin/cacti/cmd.php 0 3]
Waiting on 1/1 pollers.
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Waiting on 1/1 pollers.
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Waiting on 1/1 pollers.
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Waiting on 1/1 pollers.
11/18/2005 11:10:07 AM - SYSTEM STATS: Time:4.1209 Method:cmd.php Processes:1 Threads:N/A Hosts:3 HostsPerProcess:3 DataSources:23 RRDsProcessed:0
11/18/2005 11:10:07 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/local/bin/php, ARGS: -q /home/admin/cacti/poller_commands.php]
11/18/2005 11:10:07 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/local/bin/php, ARGS: -q /home/admin/cacti/poller_export.php]
and here the output from the cacti.log with DEBUG:

Code: Select all

11/18/2005 11:10:03 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/local/bin/php, ARGS: -q /home/admin/cacti/cmd.php 0 3]
11/18/2005 11:10:04 AM - PHPSVR: Poller[0] DEBUG: SERVER: cmd
11/18/2005 11:10:04 AM - PHPSVR: Poller[0] DEBUG: GETCWD: /home/admin/cacti/log
11/18/2005 11:10:04 AM - PHPSVR: Poller[0] DEBUG: DIRNAM: /home/admin/cacti
11/18/2005 11:10:04 AM - PHPSVR: Poller[0] DEBUG: FILENM: /home/admin/cacti/script_server.php
11/18/2005 11:10:04 AM - PHPSVR: Poller[0] PHP Script Server has Started - Parent is cmd
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] PHP Script Server Started Properly
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] PING: Host is Alive
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] SNMP: Host responded to SNMP
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] RECACHE: Processing 2 items in the auto reindex cache for '127.0.0.1'.
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[5] CMD: perl /home/admin/cacti/scripts/loadavg_multi.pl, output: 1min:1.07 5min:1.41 10min:1.06
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[15] CMD: perl /home/admin/cacti/scripts/query_unix_partitions.pl  get available /dev/twed0s1e, output: 54485876
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[15] CMD: perl /home/admin/cacti/scripts/query_unix_partitions.pl  get used /dev/twed0s1e, output: 12286040
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[16] CMD: perl /home/admin/cacti/scripts/query_unix_partitions.pl  get available /dev/twed0s1h, output: 175661000
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[16] CMD: perl /home/admin/cacti/scripts/query_unix_partitions.pl  get used /dev/twed0s1h, output: 25006352
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[20] CMD: perl /home/admin/cacti/scripts/unix_users.pl, output: 3
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[21] SNMP: v1: 127.0.0.1, dsname: proc, oid: .1.3.6.1.2.1.25.1.6.0, output: 300
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[23] SNMP: v1: 127.0.0.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.1, output: 1216424125
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[23] SNMP: v1: 127.0.0.1, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.1, output: 49078597
11/18/2005 11:10:04 AM - PHPSVR: Poller[0] DEBUG: INCLUDE: '/home/admin/cacti/scripts/ss_host_cpu.php' SCRIPT: 'ss_host_cpu' CMD: '127.0.0.1 1 1:161:500:private23:::MD5::[None] get usage 0'
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[24] SERVER: /home/admin/cacti/scripts/ss_host_cpu.php ss_host_cpu 127.0.0.1 1 1:161:500:private23:::MD5::[None] get usage 0, output: 100
11/18/2005 11:10:04 AM - PHPSVR: Poller[0] SERVER: /home/admin/cacti/scripts/ss_host_cpu.php ss_host_cpu 127.0.0.1 1 1:161:500:private23:::MD5::[None] get usage 0 output 100
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[27] SNMP: v1: 127.0.0.1, dsname: cpu_nice, oid: .1.3.6.1.4.1.2021.11.51.0, output: 4991254
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[28] SNMP: v1: 127.0.0.1, dsname: cpu_system, oid: .1.3.6.1.4.1.2021.11.52.0, output: 25076195
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[29] SNMP: v1: 127.0.0.1, dsname: cpu_user, oid: .1.3.6.1.4.1.2021.11.50.0, output: 61440887
11/18/2005 11:10:04 AM - CMDPHP: Poller[0] Host[1] DS[30] SNMP: v1: 127.0.0.1, dsname: mem_buffers, oid: .1.3.6.1.4.1.2021.4.14.0, output: 204096
11/18/2005 11:10:05 AM - CMDPHP: Poller[0] Host[1] DS[31] SNMP: v1: 127.0.0.1, dsname: mem_cache, oid: .1.3.6.1.4.1.2021.4.15.0, output: 101080
11/18/2005 11:10:05 AM - CMDPHP: Poller[0] Host[1] DS[32] SNMP: v1: 127.0.0.1, dsname: mem_free, oid: .1.3.6.1.4.1.2021.4.6.0, output: 107468
11/18/2005 11:10:05 AM - CMDPHP: Poller[0] Host[1] DS[35] SNMP: v1: 127.0.0.1, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.1, output: 1216481654
11/18/2005 11:10:05 AM - CMDPHP: Poller[0] Host[1] DS[35] SNMP: v1: 127.0.0.1, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.1, output: 49083845
11/18/2005 11:10:05 AM - CMDPHP: Poller[0] Host[1] DS[36] CMD: perl /home/admin/cacti/scripts/ping.pl 193.99.144.80, output: 2.286
11/18/2005 11:10:05 AM - CMDPHP: Poller[0] Host[1] DS[37] CMD: perl /home/admin/cacti/scripts/ping.pl 216.239.39.99, output: 88.903
11/18/2005 11:10:05 AM - CMDPHP: Poller[0] Host[1] DS[41] CMD: perl /home/admin/cacti/scripts/ws_apachestats.pl munz.org, output: apache_total_hits:251902 apache_total_kbytes:1622975 apache_busy_workers:21 apache_idle_workers:17
11/18/2005 11:10:06 AM - CMDPHP: Poller[0] Host[1] DS[42] CMD: perl /home/admin/cacti/scripts/ws_apachestats.pl munz.org, output: apache_total_hits:251903 apache_total_kbytes:1622976 apache_busy_workers:21 apache_idle_workers:17
11/18/2005 11:10:06 AM - CMDPHP: Poller[0] Host[1] DS[43] CMD: perl /home/admin/cacti/scripts/ws_apachestats.pl munz.org, output: apache_total_hits:251904 apache_total_kbytes:1622976 apache_busy_workers:19 apache_idle_workers:19
11/18/2005 11:10:06 AM - PHPSVR: Poller[0] DEBUG: PHP Script Server Shutdown request received, exiting
11/18/2005 11:10:06 AM - CMDPHP: Poller[0] Time: 2.9949 s, Theads: N/A, Hosts: 2
11/18/2005 11:10:07 AM - SYSTEM STATS: Time:4.1209 Method:cmd.php Processes:1 Threads:N/A Hosts:3 HostsPerProcess:3 DataSources:23 RRDsProcessed:0
11/18/2005 11:10:07 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/local/bin/php, ARGS: -q /home/admin/cacti/poller_commands.php]
11/18/2005 11:10:07 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/local/bin/php, ARGS: -q /home/admin/cacti/poller_export.php]
I am curious why RRDsProcessed is 0 and nothing is shown about rrdtool updates in the log.

Eearlier I got

CMDPHP: Poller[0] ERROR: Either there are no items in the cache or polling is disabled

But I do not see that anymore

Any help would be appreciated.

thanks,
Florian
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Increate your maximum memory to something like 64m in the php.ini file. Then, you should give the poller 1 more opportunity to correct itself. The issue you are having is that your poller_output table is too large to be returned properly.

I am looking at a MOD to fix this. However, today, if you want it fixed you will either have to run once more with more PHP memory or perform the following steps, which will cause data loss.

mysql -u root -p cacti
> truncate table poller_output;
> quit

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
theflow
Posts: 4
Joined: Fri Nov 18, 2005 5:10 am

Post by theflow »

Hi,

thanks for your quick reply.
TheWitness wrote:Increate your maximum memory to something like 64m in the php.ini file. Then, you should give the poller 1 more opportunity to correct itself. The issue you are having is that your poller_output table is too large to be returned properly.
the poller_output table is currently empty and is empty in every database backup I have. So truncating does not help here :(


Florian
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Please run "php poller.php" from the cacti web root in LOW. Post the output.

Larry
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Also, please "View Poller Cache" and post.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
theflow
Posts: 4
Joined: Fri Nov 18, 2005 5:10 am

Post by theflow »

poller:

Code: Select all

Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
Cannot find module (NONE): At line 0 in (none)
11/18/2005 12:58:17 PM - SYSTEM STATS: Time:4.1912 Method:cmd.php Processes:1 Threads:N/A Hosts:3 HostsPerProcess:3 DataSources:23 RRDsProcessed:0
poller cache:

Code: Select all

Data Source: Localhost - Traffic - 217.175.253.222/fxp0
RRD: /home/admin/cacti/rra/localhost_traffic_in_23.rrd
Action: 0, OID: .1.3.6.1.2.1.2.2.1.10.1 (Host: 127.0.0.1, Community: private23)
Data Source: Localhost - Traffic - 217.175.253.222/fxp0
RRD: /home/admin/cacti/rra/localhost_traffic_in_23.rrd
Action: 0, OID: .1.3.6.1.2.1.2.2.1.16.1 (Host: 127.0.0.1, Community: private23)
Data Source: Localhost - Load Average
RRD: /home/admin/cacti/rra/localhost_load_1min_5.rrd
Action: 1, Script: perl /home/admin/cacti/scripts/loadavg_multi.pl
Data Source: Localhost - CPU Utilization - CPU0
RRD: /home/admin/cacti/rra/localhost_cpu_24.rrd
Action: 2, Script: /home/admin/cacti/scripts/ss_host_cpu.php ss_host_cpu 127.0.0.1 1 1:161:500:private23:::MD5::[None] get usage 0
Data Source: Localhost - CPU Usage - Nice
RRD: /home/admin/cacti/rra/localhost_cpu_nice_27.rrd
Action: 0, OID: .1.3.6.1.4.1.2021.11.51.0 (Host: 127.0.0.1, Community: private23)
Data Source: Localhost - CPU Usage - System
RRD: /home/admin/cacti/rra/localhost_cpu_system_28.rrd
Action: 0, OID: .1.3.6.1.4.1.2021.11.52.0 (Host: 127.0.0.1, Community: private23)
Data Source: Localhost - CPU Usage - User
RRD: /home/admin/cacti/rra/localhost_cpu_user_29.rrd
Action: 0, OID: .1.3.6.1.4.1.2021.11.50.0 (Host: 127.0.0.1, Community: private23)
Data Source: Localhost - Processes
RRD: /home/admin/cacti/rra/localhost_proc_21.rrd
Action: 0, OID: .1.3.6.1.2.1.25.1.6.0 (Host: 127.0.0.1, Community: private23)
Data Source: Localhost - Logged in Users
RRD: /home/admin/cacti/rra/localhost_users_20.rrd
Action: 1, Script: perl /home/admin/cacti/scripts/unix_users.pl
Data Source: Localhost - Free Space - /dev/twed0s1e
RRD: /home/admin/cacti/rra/localhost_hdd_free_15.rrd
Action: 1, Script: perl /home/admin/cacti/scripts/query_unix_partitions.pl get available /dev/twed0s1e
Data Source: Localhost - Free Space - /dev/twed0s1e
RRD: /home/admin/cacti/rra/localhost_hdd_free_15.rrd
Action: 1, Script: perl /home/admin/cacti/scripts/query_unix_partitions.pl get used /dev/twed0s1e
Data Source: Localhost - Free Space - /dev/twed0s1h
RRD: /home/admin/cacti/rra/localhost_hdd_free_16.rrd
Action: 1, Script: perl /home/admin/cacti/scripts/query_unix_partitions.pl get available /dev/twed0s1h
Data Source: Localhost - Free Space - /dev/twed0s1h
RRD: /home/admin/cacti/rra/localhost_hdd_free_16.rrd
Action: 1, Script: perl /home/admin/cacti/scripts/query_unix_partitions.pl get used /dev/twed0s1h
Data Source: Localhost - Memory - Buffers
RRD: /home/admin/cacti/rra/localhost_mem_buffers_30.rrd
Action: 0, OID: .1.3.6.1.4.1.2021.4.14.0 (Host: 127.0.0.1, Community: private23)
Data Source: Localhost - Memory - Cache
RRD: /home/admin/cacti/rra/localhost_mem_cache_31.rrd
Action: 0, OID: .1.3.6.1.4.1.2021.4.15.0 (Host: 127.0.0.1, Community: private23)
Data Source: Localhost - Memory - Free
RRD: /home/admin/cacti/rra/localhost_mem_free_32.rrd
Action: 0, OID: .1.3.6.1.4.1.2021.4.6.0 (Host: 127.0.0.1, Community: private23)
Data Source: Localhost - Ping Host
RRD: /home/admin/cacti/rra/localhost_ping_36.rrd
Action: 1, Script: perl /home/admin/cacti/scripts/ping.pl 193.99.144.80
Data Source: Localhost - Traffic - 217.175.253.222/fxp0
RRD: /home/admin/cacti/rra/localhost_traffic_in_35.rrd
Action: 0, OID: .1.3.6.1.2.1.2.2.1.10.1 (Host: 127.0.0.1, Community: private23)
Data Source: Localhost - Traffic - 217.175.253.222/fxp0
RRD: /home/admin/cacti/rra/localhost_traffic_in_35.rrd
Action: 0, OID: .1.3.6.1.2.1.2.2.1.16.1 (Host: 127.0.0.1, Community: private23)
Data Source: Localhost - Ping Host
RRD: /home/admin/cacti/rra/localhost_ping_37.rrd
Action: 1, Script: perl /home/admin/cacti/scripts/ping.pl 216.239.39.99
Data Source: Localhost - Apache Statistics
RRD: /home/admin/cacti/rra/localhost_apache_idle_workers_43.rrd
Action: 1, Script: perl /home/admin/cacti/scripts/ws_apachestats.pl munz.org
Data Source: Localhost - Apache Statistics
RRD: /home/admin/cacti/rra/localhost_apache_idle_workers_42.rrd
Action: 1, Script: perl /home/admin/cacti/scripts/ws_apachestats.pl munz.org
Data Source: Localhost - Apache Statistics
RRD: /home/admin/cacti/rra/localhost_apache_idle_workers_41.rrd
Action: 1, Script: perl /home/admin/cacti/scripts/ws_apachestats.pl munz.org
thanks,
Florian
Top
theflow
Posts: 4
Joined: Fri Nov 18, 2005 5:10 am

Post by theflow »

Okay, I've found it. The database had some serious issues with mysql collations and the join on line 248 in lib/poller.php didn't work and threw a sql error.

I probably know the reason for the collation problems, but why isn't there some better error reporting on mysql queries?


Florian
Top
Post Reply

Return to “Help: Linux/Unix Specific”

Who is online

Users browsing this forum: No registered users and 7 guests