Boost Sanity question..

boulan · Post by **boulan** » Tue Nov 20, 2007 7:16 pm

Hey all... I've got kind of a sanity check question here. I feel like after a couple of changes (adding some more hosts, adding error graphs in addition to traffic, upgrading spine and cacti and the PIA), I've got the boost poller process running infinitely it seems.

I've got the boost poller running from cron (as it doesn't seem to do anything if I don't do that). The line in cron (as given to me by TheWitness):

Code: Select all

0 */1 * * * /usr/local/bin/php -q /var/www/cacti-0.8.7a/plugins/boost/poller_boost.php -f -d

What should I realistically expect here? I extended the boost poller process to run for an hour max and it's even hitting that. I've got a 5 minute polling time (takes about a minute)

Code: Select all

Current Boost Status
Boost On Demand Updating:	Running
Total Data Sources:	152704
Total Boost Records:	61306

Previous Runtime
Last Start Time:	2007-11-20 19:00:02
Last Run Duration:	3600.5804 Seconds
RRD's Updated:	13869763

That seems like an awful lot of records updated to me, but maybe that's accurate... 60 minutes / 5 would be 12 polls... 12 * 152704 would be 1832448.. Should I be expecting roughly 1832448?

Code: Select all

11/20/2007 07:00:02 PM - SYSTEM BOOST STATS: Time:3600.5804 RRDUpdates:13869763
11/20/2007 07:00:02 PM - CMDPHP: Poller[0] FATAL: RRD On Demand Updater Exceeded Runtime Limits!!!

I'm using the rrdtool from the 1.3 beta, just to see if it helped (it didn't really, assuming I did everything right). Just trying to figure out if there's a way to optimize that better somehow.

Post by **TheWitness** » Tue Nov 20, 2007 11:42 pm

There is a problem with boost right now. If you get the SVN version, you can force the updates in CRON and they will complete fine.

TheWitness

boulan · Post by **boulan** » Wed Nov 21, 2007 9:36 am

Alright, I'll grab the SVN, but just to be clear - I am forcing the updates via cron, and that's fine. I'm more asking about the performance of the update process. I'll try the SVN and see if that helps speed things up.

Post by **TheWitness** » Wed Nov 21, 2007 9:40 am

It was a rather nasty bug. I provided the fix to a user and it make updating 1+ million RRDupdates a snap instead of a crawl. Having memory is still key of course.

TheWitness

boulan · Post by **boulan** » Wed Nov 21, 2007 10:10 am

That's excellent, thank you. I've got 14G, which should be 16G in a bit. I can throw more at it next year probably, but we'll see how it goes. Again, thanks for this plugin and all the help!

boulan · Post by **boulan** » Wed Nov 21, 2007 10:30 am

Code: Select all

Last Start Time:	2007-11-21 10:27:19
Last Run Duration:	205.9021 Seconds
RRD's Updated:	156584

That seems to make a lot more sense to me

Post by **TheWitness** » Wed Nov 21, 2007 1:08 pm

You should be able to push 1m plus updates in about the same time. The real trick is making sure you have enough memory for heap tables not to run out. If you are pretty much all SNMP, you can alter the boost output table to about 40-50 bytes per row and really allow more data to be stored.

TheWitness

boulan · Post by **boulan** » Wed Nov 21, 2007 5:04 pm

I've currently given 1G to the mysql heap tables and 1G to php. The box has 14G (with 2G more coming whenever the RMA gets back). I figured that was enough... so far it seems to be.

Pretty much everything is SNMP so far, but my boss likes to ask me to do stuff randomly and I'm not positive that 6 months down the road I'm going to remember that change.

Alice · Post by **Alice** » Thu Nov 22, 2007 8:38 pm

Call me stupid, but where can I find the SVN version of boost?
Thanx!

Post by **TheWitness** » Fri Nov 23, 2007 12:02 am

At the cacti site. It's almost the same path as Cacti. But instead it is "cacti-plugins" after SVNROOT.

TheWitness

Alice · Post by **Alice** » Fri Nov 23, 2007 3:25 am

What am I doing wrong?
root@stats3:~/svn# svn checkout svn://svn.cacti.net/var/svnroot/cacti-plugins
svn: No repository found in 'svn://svn.cacti.net/var/svnroot/cacti-plugins'

Post by **TheWitness** » Fri Nov 23, 2007 12:29 pm

My appologies:

Code: Select all

svn://anonymous@svn.cacti.net/var/svnroot/cacti_plugins

TheWitness

Marcel · Post by **Marcel** » Fri Nov 30, 2007 5:08 pm

TheWitness wrote:There is a problem with boost right now. If you get the SVN version, you can force the updates in CRON and they will complete fine.

I've just downloaded the boost plugin from cactiusers.org and read this post. Is it still broken as of now?

Beyond that, if running the boost_server.php, am i still need to run poller.php from cron? Or should I replace the stock poller.php by poller_boost.php?

The README file is somewhat confusing. Not sure about all the steps to put boost up and running.

Thank you in advance.

Marcel

Marcel · Post by **Marcel** » Mon Dec 03, 2007 11:03 am

Managed to make boost plugin working here. Thank you again for this boost plugin.

guigzmorez · Post by **guigzmorez** » Fri Oct 31, 2008 5:18 am

Hello Marcel,

I have seen that you have succeeded in making work boost. you are a star :

...
Personnaly, I can't.
Can U tell me how you did it?
I have downloaded boost1.7 on cactiusers.
When I try to start it, Boost_server don't show nothing even no error messages so my boost server don't work. Did you activate only poller_boost in cron ?
If you only have cron then on demand graphing does not work, does it?

Note that I have realtime and reportit plugins graphs working.
cacti 0.8.7b on linux RHEL4.
I don't know if you can help me, but you are my last hope about this buggy Boost

Hope hearing from you.

Bye,

Guillaume

Cacti

Boost Sanity question..

Boost Sanity question..

solved

Boost help

Who is online