Testers Needed for Boost Plugin

Post by **TheWitness** » Mon Nov 06, 2006 6:54 am

Hello all, I am pretty close to completing a new plugin called Boost. It incorporates a few good features into Cacti to improve performance for larger sites and I am looking for some testers.

If you are interested, please post here your interest. I will make this the official posting location for the plugin and all "beta" versions.

So that you understand, here is what the plugin does:

This plugin boost's Cacti performance especially for Large Sites. It does this by introducing three new features to Cacti.

First, it recently viewed images to a public Cache folder. Second, it introduces an on demand RRD update feaure. This forces the update of RRD's prior to graph viewing and then schedules large batch RRD update's at pre-defined periods.

- Image Caching
- On Demand RRD Updates
- Optional RRD Update Service
- Host Subdirectories (TBD)

Regards,

TheWitness

streaker69 · Post by **streaker69** » Mon Nov 06, 2006 7:48 am

I know that N3NCY will be more than interested in testing it for you. May as well send it to him now before he has a chance to read this.

Post by **TheWitness** » Mon Nov 06, 2006 11:46 am

He's signed up (willing or not

) and has beta2 of the plugin. I don't know if he's attempted to use it yet. Are you interested in "testing"?

TheWitness

streaker69 · Post by **streaker69** » Mon Nov 06, 2006 1:34 pm

I don't think I'd be a good test for it. I only have 17 hosts and 228 RRA's. Probably isn't going to have that much affect on me. Next spring I'll be doubling what I have as I'm converting a SCADA network into ethernet, but for now, I don't think it'd be worth it.

moonman · Post by **moonman** » Mon Nov 06, 2006 3:50 pm

I would like to beta test it.

I would also like to know what are the risks of the plugin (can it corrupt the DB or it can only cause lost of some updates in case of a failed update ) ?

My site have more then 5000 graphs

Thanks

Post by **TheWitness** » Mon Nov 06, 2006 3:54 pm

Moonman,

The plugin requires a new table called poller_output_boost. There are also modified files in the base install. It should be pretty harmless other than potential lost data. Before I perform a general release, I want to work out a few features.

At 5000 graphs, you should benefit from some reduced IO Wait times. You need to be cautious about database settings though. More to follow.

Larry

Alice · Post by **Alice** » Wed Nov 08, 2006 11:33 am

285 devices, 2839 datasources, 1992 graphs and counting.
Do I qualify?

Post by **TheWitness** » Wed Nov 08, 2006 5:48 pm

Sure, but we are experiencing some issue's at the moment. I would prefer it if you have the same setup on a test box where you don't F$@# the production data. Can you do that?

Larry

Frizz · Post by **Frizz** » Thu Nov 09, 2006 5:43 pm

TheWitness wrote: ....
It incorporates a few good features into Cacti to improve performance for larger sites and I am looking for some testers.
...

Hello, thats what we wish for.
Performance for at least 10.000 devices with up to 100.000 RRD's.
As good as we have analyse it, 60% of our polling cycle was used for the RRDtool(update) function and not the polling of the SNMP data.
Currently we need about 170-180 sec for 33.000 RRD's from 1900 hosts, but we have sometime a jitter up to 300 sec as you can see in the attached graph.

Our used production enviroment for the Database/polling server
2 x 2.7GHz Xeon, Suse Linux 8.2 under VM/ESX server, 4GB RAM,IHS Webserver 2.0.42.1 ( IBM, based on Apache ), RRDTool 1.0.49, MySQL 4.0.24, PHP 4.3.8, Cacti 0.8.6g, Cactid 0.8.6f

A problem occurs , when the first polling process exceeded the 300 sec, the next scheduled cycle will need even more time, and so on.
We run in a polling loop.
The only process that has not finished is alway the RRDtool(update).
Killing this RRDtool processes and start the next poller manually until it's runtime fall below the 300 sec is the solution to clean up this loop.
So the idea to speed up the RRDtool process working only in RAM will be the right approach.
The structured RRD directory is also a good approach to overcome a Linux immanent (inode) problem.

TheWitness wrote: ...
If you are interested, please post here your interest. I will make this the official posting location for the plugin and all "beta" versions.
...

Yes we are interested to be "beta" tester on our prototype box, where we can tune up the count of RRD files up to the hardware limits.
If you are interested I will contact you via mail.
Best regards
Frizz

Alice · Post by **Alice** » Fri Nov 10, 2006 2:37 pm

TheWitness wrote:Sure, but we are experiencing some issue's at the moment. I would prefer it if you have the same setup on a test box where you don't F$@# the production data. Can you do that?

Larry

Certainly, I want to move my production system to another machine and I test everything on that right now

Post by **TheWitness** » Fri Nov 10, 2006 4:15 pm

Alice,

I sent you Beta7 via a PM. Please send e-mails regarding this subject to the distribution I will send you via e-mail momentarily. Remember, it's not ready for production at the moment.

Larry

Alice · Post by **Alice** » Fri Nov 10, 2006 5:13 pm

Got it, thanx.
I'll try it on Monday.

rock_manlove · Post by **rock_manlove** » Sun Nov 12, 2006 3:02 pm

I want to try Boost on my development Cacti.

Thanks.

cwahlin · Post by **cwahlin** » Mon Nov 13, 2006 1:21 pm

I'd be willing to test the boost plugin.

As you saw in my other post (http://forums.cacti.net/about17668.html) I am only running 50 hosts, but 8895 data sources

(Cisco 6509s with LOTS of interfaces and other things that need to be polled).

I am running my old server still so I won't lose any important data.

/Carl

Alice · Post by **Alice** » Mon Nov 13, 2006 7:12 pm

I am sorry, but I am VERY busy these days

Quick note, maybe it was MY fault, maybe not:
With logarithmic auto-scaling, when I tried to view graphs, the server allmost died. rrdtool was eating a lot of memory & CPU time.
I didn't ried to reproduce bug. As I said, I don't have time. Sorry.

Cacti

Testers Needed for Boost Plugin

Testers Needed for Boost Plugin

Re: Testers Needed for Boost Plugin

Who is online