Spine question

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

Post Reply
jfauteux
Posts: 49
Joined: Fri Apr 30, 2004 8:56 am

Spine question

Post by jfauteux »

When I switch from cmp.php to spine, in an effort to better performance, my rrd's do not get updated. I can see in debug mode that all the snmp queries happen ( and fast too) but no rrd updates. Am I doing something wrong?


my tech support stuff
Date Tue, 16 Feb 2010 13:38:25 -0500
Cacti Version 0.8.7e
Cacti OS unix
SNMP Version NET-SNMP version: 5.1.2
RRDTool Version RRDTool 1.2.x
Hosts 57
Graphs 2251
Data Sources Script/Command: 61
SNMP: 57
SNMP Query: 2129
Script - Script Server (PHP): 5
Total: 2252
Poller Information
Interval 300
Type cmd.php
Items Action[0]: 4313
Action[1]: 61
Action[2]: 5
Total: 4379
Concurrent Processes 10
Max Threads 15
PHP Servers 8
Script Timeout 25
Max OID 60
Last Run Statistics Time:480.4101 Method:cmd.php Processes:10 Threads:N/A Hosts:58 HostsPerProcess:6 DataSources:4379 RRDsProcessed:2249
PHP Information
PHP Version 4.3.9
PHP OS Linux
PHP uname Linux sslmsysmon6 2.6.9-89.0.9.ELsmp #1 SMP Wed Aug 19 08:06:10 EDT 2009 x86_64
PHP SNMP Installed
max_execution_time 30
memory_limit 72M
Top
locutus233
Posts: 14
Joined: Tue Mar 17, 2009 2:49 pm

Post by locutus233 »

I don't think your install is configured correctly? is your run time exceeding 300seconds?

Last Run Statistics Time:480.4101 Method:cmd.php Processes:10 Threads:N/A Hosts:58 HostsPerProcess:6 DataSources:4379 RRDsProcessed:2249
Top
jfauteux
Posts: 49
Joined: Fri Apr 30, 2004 8:56 am

Post by jfauteux »

yes it is, those stats are with cmd.php - should spine actually update the rrd's too?
Top
jfauteux
Posts: 49
Joined: Fri Apr 30, 2004 8:56 am

Post by jfauteux »

This is what I see in the log when I use spine - notice it says RRD'sprocessed = 0

02/17/2010 10:35:10 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/bin/spine, ARGS: 691 696]
02/17/2010 10:35:10 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/bin/spine, ARGS: 697 703]
02/17/2010 10:35:11 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/bin/spine, ARGS: 704 713]
02/17/2010 10:35:11 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/bin/spine, ARGS: 714 719]
02/17/2010 10:35:12 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/bin/spine, ARGS: 720 730]
02/17/2010 10:35:12 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/bin/spine, ARGS: 731 737]
02/17/2010 10:35:13 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/bin/spine, ARGS: 738 743]
02/17/2010 10:40:05 AM - POLLER: Poller[0] Maximum runtime of 298 seconds exceeded. Exiting.
02/17/2010 10:40:06 AM - SYSTEM STATS: Time:299.4745 Method:spine Processes:10 Threads:15 Hosts:58 HostsPerProcess:6 DataSources:4370 RRDsProcessed:0
02/17/2010 10:40:07 AM - POLLER: Poller[0] -1266421207.3777 seconds
Top
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:
Contact gandalf

Post by gandalf »

Please run spine in debug mode against a single host as told in 2nd link of my sig. Don't expect any rrdtool update then; this is just a test.
Then run the poller using --force and mdium logging level
R.
Top
jfauteux
Posts: 49
Joined: Fri Apr 30, 2004 8:56 am

Post by jfauteux »

Gandalf - thanks - here is the output of the first one - spine isnt recognizing --force so I'm unable to run the second one

bash-3.00$ /usr/bin/spine --verbosity=5 686 686
SPINE: Using spine config file [spine.conf]
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The path_php_server variable is /sysadm/shared/www/Cacti-CPE/script_server.php
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The path_cactilog variable is /sysadm/shared/www/Cacti-CPE/log/cacti.log
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The log_destination variable is 1 (FILE)
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The path_php variable is /usr/bin/php
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The availability_method variable is 2
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The ping_recovery_count variable is 3
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The ping_failure_count variable is 2
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The ping_method variable is 2
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The ping_retries variable is 1
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The ping_timeout variable is 300
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The log_perror variable is 1
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The log_pwarn variable is 1
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The log_pstats variable is 1
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The threads variable is 15
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The polling interval is 300 seconds
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The number of concurrent processes is 10
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The script timeout is 25
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The number of php script servers to run is 8
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: StartHost='686', EndHost='686', TotalPHPScripts='0'
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The PHP Script Server is Not Required
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The Maximum SNMP OID Get Size is 1
02/17/2010 01:49:57 PM - SPINE: Poller[0] Version 0.8.7c starting
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: MySQL is Thread Safe!
02/17/2010 01:49:57 PM - SPINE: Poller[0] SPINE: Initializing Net-SNMP API
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: SNMP Header Version is 5.1.2
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: SNMP Library Version is 5.1.2
02/17/2010 01:49:57 PM - SPINE: Poller[0] SPINE: Initializing PHP Script Server(s)
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: Initial Value of Active Threads is 0
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
02/17/2010 01:49:57 PM - SPINE: Poller[0] Host[0] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 2
02/17/2010 01:49:57 PM - SPINE: Poller[0] Host[686] SNMP Result: Host responded to SNMP
02/17/2010 01:49:57 PM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
02/17/2010 01:49:57 PM - SPINE: Poller[0] Host[686] RECACHE: Processing 1 items in the auto reindex cache for '172.25.40.36'
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DEBUG: The POPEN returned the following File Descriptor 7
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10328] SCRIPT: /sysadm/shared/www/Cacti-CPE/scripts/cisco_memory_percent_only.sh PtiSlm298 172.25.40.36, output: iopercentused:32 procpercentused:9
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10327] SNMP: v1: 172.25.40.36, dsname: 5min_cpu, oid: .1.3.6.1.4.1.9.2.1.58.0, value: 1
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10329] SNMP: v1: 172.25.40.36, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.1, value: 3414427755
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10329] SNMP: v1: 172.25.40.36, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.1, value: 3297068055
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10330] SNMP: v1: 172.25.40.36, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.6, value: 3627390742
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10330] SNMP: v1: 172.25.40.36, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.6, value: 2217657432
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10331] SNMP: v1: 172.25.40.36, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.11, value: 3378007567
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10331] SNMP: v1: 172.25.40.36, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.11, value: 3256912518
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10332] SNMP: v1: 172.25.40.36, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.12, value: 311628904
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10332] SNMP: v1: 172.25.40.36, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.12, value: 341726779
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10333] SNMP: v1: 172.25.40.36, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.13, value: 202971018
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10333] SNMP: v1: 172.25.40.36, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.13, value: 232193253
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10334] SNMP: v1: 172.25.40.36, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.14, value: 205528097
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[10334] SNMP: v1: 172.25.40.36, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.14, value: 196910812
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[11710] SNMP: v1: 172.25.40.36, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.15, value: 352716846
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[11710] SNMP: v1: 172.25.40.36, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.15, value: 296952153
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[11711] SNMP: v1: 172.25.40.36, dsname: traffic_in, oid: .1.3.6.1.2.1.2.2.1.10.17, value: 163579727
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DS[11711] SNMP: v1: 172.25.40.36, dsname: traffic_out, oid: .1.3.6.1.2.1.2.2.1.16.17, value: 149621909
02/17/2010 01:49:58 PM - SPINE: Poller[0] Host[686] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
02/17/2010 01:49:58 PM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 0
02/17/2010 01:49:58 PM - SPINE: Poller[0] DEBUG: Thread Cleanup Complete
02/17/2010 01:49:58 PM - SPINE: Poller[0] DEBUG: PHP Script Server Pipes Closed
02/17/2010 01:49:58 PM - SPINE: Poller[0] DEBUG: Allocated Variable Memory Freed
02/17/2010 01:49:58 PM - SPINE: Poller[0] DEBUG: MYSQL Free & Close Completed
02/17/2010 01:49:58 PM - SPINE: Poller[0] Time: 0.5960 s, Threads: 15, Hosts: 2
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Well, the force option is run differently:

Code: Select all

php -q poller.php --force
However, you need to:

1) Verify that the path to spine is set properly Console->Settings->Paths

2) Verify that spine runs all the way this way.

Code: Select all

./spine -R -V 3
TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
jfauteux
Posts: 49
Joined: Fri Apr 30, 2004 8:56 am

Post by jfauteux »

spine -R -V 3 - seems to run ok, i can see all the snmp queries completing

php -q poller.php --force -- this doesnt look good. My spine bin path under settings looks good

02/18/2010 10:12:31 AM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: /usr/bin/spine, ARGS: 738 743]
02/18/2010 10:12:31 AM - SPINE: Poller[0] FATAL: Unable to read configuration file! (Spine init)
Waiting on 10/10 pollers.
Waiting on 10/10 pollers.
Waiting on 10/10 pollers.
Waiting on 10/10 pollers.
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Where is spine? Where is the spine.conf file. Best to have it in /etc

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
jfauteux
Posts: 49
Joined: Fri Apr 30, 2004 8:56 am

Post by jfauteux »

spine.conf is in /usr/local/spine
spine binary is in /usr/bin/spine

do you think this is the problem, even though under >settings>path it says OK:FILE FOUND?
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Yes, put it in /etc or in the spine bin directory.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
jfauteux
Posts: 49
Joined: Fri Apr 30, 2004 8:56 am

Post by jfauteux »

Witness - that did the trick! Thank you.

should I be concerned with these that I'm seeing in the log. I'm guessing I should

02/24/2010 09:10:16 AM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating
02/24/2010 09:10:16 AM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating
02/24/2010 09:10:16 AM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating
02/24/2010 09:10:16 AM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating
02/24/2010 09:10:16 AM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating
02/24/2010 09:10:16 AM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating
02/24/2010 09:10:16 AM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating
02/24/2010 09:10:16 AM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating
02/24/2010 09:10:09 AM - SPINE: Poller[0] FATAL: Connection Failed, Error:'1040', Message:'Too many connections' (Spine thread)
02/24/2010 09:10:09 AM - SPINE: Poller[0] FATAL: Connection Failed, Error:'1040', Message:'Too many connections' (Spine thread)
02/24/2010 09:10:09 AM - SPINE: Poller[0] FATAL: Connection Failed, Error:'1040', Message:'Too many connections' (Spine thread)
02/24/2010 09:10:09 AM - SPINE: Poller[0] FATAL: Connection Failed, Error:'1040', Message:'Too many connections' (Spine thread)
02/24/2010 09:10:09 AM - SPINE: Poller[0] FATAL: Connection Failed, Error:'1040', Message:'Too many connections' (Spine thread)
02/24/2010 09:10:07 AM - SPINE: Poller[0] FATAL: Connection Failed, Error:'1040', Message:'Too many connections' (Spine thread)
Top
Post Reply

Return to “Help: General”

Who is online

Users browsing this forum: No registered users and 2 guests