boost_server.php consumes 99% cpu

General discussion about Plugins for Cacti

Moderators: Developers, Moderators

deu439356
Cacti User
Posts: 73
Joined: Wed Aug 13, 2008 8:08 am

Post by deu439356 »

I am not seeing any other errors and I am using the lastest version of Boost from the SVN. Do you know if there is a new poller that is supposed to be installed with boost? I am running 8.7b
khufure
Cacti User
Posts: 203
Joined: Wed Oct 24, 2007 5:47 pm
Location: San Francisco, CA
Contact:

Post by khufure »

khufure wrote:What version of boost? You should be using the Subversion one. Latest stable (1.7) is not really usable.

Are there any messages about boost around the 2006 errors? E.g.

Code: Select all

ERROR: Timeout detected.  Boost server is down.  Contact support immediately!!
Nevermind, I see in your log similar messages do exist. Checkout the last 2 pages of http://forums.cacti.net/viewtopic.php?t=18430 for a way to restart the boost server if/when it dies.
User avatar
TheWitness
Developer
Posts: 17047
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

I would make it an inittab process.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
deu439356
Cacti User
Posts: 73
Joined: Wed Aug 13, 2008 8:08 am

Post by deu439356 »

Ok. We turned the multiprocess server back on to help write the RRDs faster when the boost poller runs every hour (which we have to force). It seems that the mysql errors (the 2006 error) was being caused by boost getting backed up. We have also increased the allowed run time of boost so it has enough time to write to the RRDs. The last time boost ran, it took close to 1400 seconds. My next question is: why didn't the poller time decrease when we installed boost?

SYSTEM STATS: Time:265.0897 Method:spine Processes:15 Threads:15 Hosts:1025 HostsPerProcess:69 DataSources:120435 RRDsProcessed:0


Thanks,
User avatar
TheWitness
Developer
Posts: 17047
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

Please provide some details from the Tech Support page. Only the counts of what is being polled, I don't care about the various PHP modules and their settings, besides, you shouldn't post that here anyway.

The reason that the polling time went down in general is that you don't have to wait on Disk I/O.

The solution to your problem is multi-fold. We can discuss that more when I have additional information from you.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
deu439356
Cacti User
Posts: 73
Joined: Wed Aug 13, 2008 8:08 am

Post by deu439356 »

Code: Select all

Technical Support
 
[b]General Information [/b]
Date Fri, 10 Oct 2008 09:27:10 -0500 
Cacti Version 0.8.7b 
Cacti OS unix 
SNMP Version net-snmp 
RRDTool Version RRDTool 1.2.x 
Hosts 1387 
Graphs 40447 
Data Sources:
                  Script/Command: 2
                  SNMP: 2932
                  SNMP Query: 39000
                  Script - Script Server (PHP): 4
                  Script Query - Script Server: 124
                  Total: 42062 



[b]Poller Information [/b]
Interval 300 
Type spine 
Items: 
                  Action[0]: 120219
                  Action[1]: 2
                  Action[2]: 252
                  Total: 120473 

Concurrent Processes 15 
Max Threads 15 
PHP Servers 10 
Script Timeout 45 
Max OID 20 
Last Run Statistics Time:251.7290 Method:spine Processes:15 Threads:15 Hosts:1035 HostsPerProcess:69 DataSources:120471 RRDsProcessed:0
Attachments
Why didn't the poller time decrease when we installed boost?
Why didn't the poller time decrease when we installed boost?
pollerRuntime.JPG (26.75 KiB) Viewed 6997 times
dononeil
Cacti User
Posts: 194
Joined: Wed Aug 06, 2008 4:45 pm

Post by dononeil »

I'm experiencing a similar problem... boost server chews up all the CPU it can get after running for 24 hours. Restarting it seems to solve the issue.

I'm running the latest SVN as of 10/18/08.
Attachments
untitled.PNG
untitled.PNG (31.29 KiB) Viewed 6853 times
User avatar
TheWitness
Developer
Posts: 17047
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

Could be rrdtool segmentation faults causing the race condition. Try going using cacti 0.8.7c-beta1 and see if the problem is resolved.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
dononeil
Cacti User
Posts: 194
Joined: Wed Aug 06, 2008 4:45 pm

Post by dononeil »

I can't just 'try going to beta' code to see if this fixes the problem without some more specific indications as to where the problem is coming from.

I could however upgrade to the latest RRDtool if you think that would make a difference.
khufure
Cacti User
Posts: 203
Joined: Wed Oct 24, 2007 5:47 pm
Location: San Francisco, CA
Contact:

Post by khufure »

dononeil wrote:I can't just 'try going to beta' code to see if this fixes the problem without some more specific indications as to where the problem is coming from.

I could however upgrade to the latest RRDtool if you think that would make a difference.
rrdtool-1.3.x will segfault. you could try 1.2.27 or 1.2.28G (or whatever they are calling the version with the font patch).
dononeil
Cacti User
Posts: 194
Joined: Wed Aug 06, 2008 4:45 pm

Post by dononeil »

You sure they haven't fixed it in the latest 1.3.4 version just released last month?
ceyounger
Posts: 44
Joined: Fri Feb 10, 2006 2:59 pm
Location: Orange County, CA
Contact:

Post by ceyounger »

Throwing my hat into the ring.

I have the same errors listed here. Had to disable on-demand updating, which defeats the purpose of this plugin.

I implemented all the steps listed in this thread and everytime I turn on on-demand updating I get the 2006 errors.
dononeil
Cacti User
Posts: 194
Joined: Wed Aug 06, 2008 4:45 pm

Post by dononeil »

Ok... I built rrdtool 1.2.28 and as soon as I replace the original 1.2.15 binaries I have on my system with those the text rendering breaks (no text at all).

Any ideas what could be causing this?
khufure
Cacti User
Posts: 203
Joined: Wed Oct 24, 2007 5:47 pm
Location: San Francisco, CA
Contact:

Post by khufure »

dononeil wrote:Ok... I built rrdtool 1.2.28 and as soon as I replace the original 1.2.15 binaries I have on my system with those the text rendering breaks (no text at all).

Any ideas what could be causing this?
A bug in rrdtool-1.2.28. Get the patch or use 1.2.27.
dononeil
Cacti User
Posts: 194
Joined: Wed Aug 06, 2008 4:45 pm

Post by dononeil »

Ok... I've patched rrdtool 1.28 as well as tried rrdtool 1.27 and I'm still seeing the same issue. See the attached image. It seems to happen after 24 hours as you can see.
Attachments
cpu load.PNG
cpu load.PNG (47.92 KiB) Viewed 6558 times
Post Reply

Who is online

Users browsing this forum: No registered users and 1 guest