Spikekill 1.0 - Released

Announcements concerning Plugins for Cacti

Moderators: Developers, Moderators

User avatar
TheWitness
Developer
Posts: 17059
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Spikekill 1.0 - Released

Post by TheWitness »

All,

It's been a while since there was a good spike killer for Cacti. Attached please find my latest work. It is a much more advanced Spike Killer than Alice's. It uses my own design to ferret out the Spikes from an RRDfile and remove them.

There are several options. So make sure you goto Settings->Misc and check them out. It uses one of two methods to remove spikes. There is Standard Deviation and Variance.

The Standard Deviation removes anything that is over X Standard Deviations above or below the Average. The Variance, will take away X outliers both above and below the average and then remove anything that is greater than X% above the Variance Average.

You have the ability to replace the Spike Value with either an NaN or the Average of that RRA period. You also have the ability to perform Dryrun's before you actually execute the Spike Removal. Please do so in order to "tweak" the install before running it.

The command also works from the command line and equally works even if you don't have Cacti!!!

I am looking for specific feedback on this feature and look forward to that.

Regards,

TheWitness
Attachments
spikekill-1.0-2.tar.gz
Now working for Linux/UNIX
(34.68 KiB) Downloaded 1783 times
spikekill-1.0-1.tar.gz
Works fine with Windows
(34.63 KiB) Downloaded 655 times
Last edited by TheWitness on Mon Mar 02, 2009 10:03 pm, edited 1 time in total.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Findarato
Posts: 29
Joined: Wed Feb 06, 2008 2:56 pm

Post by Findarato »

Disregard. I found the problem and fixed it. It works great now
[b]Cacti Version[/b] - 0.8.7d [b]Plugin Architecture[/b] - 2.4 [b]Poller Type[/b] - CMD.php [b]Server Info[/b] - Linux 2.6.18-164.9.1.el5 [b]Web Server[/b] - Apache/2.2.3 (CentOS) [b]PHP[/b] - 5.1.6 [b]PHP Extensions[/b] - libxml, xml, wddx, tokenizer, sysvshm, sysvsem, sysvmsg, standard, SimpleXML, sockets, SPL, shmop, session, Reflection, pspell, posix, mime_magic, iconv, hash, gmp, gettext, ftp, exif, date, curl, ctype, calendar, bz2, zlib, pcre, openssl, apache2handler, dbase, gd, mysql, mysqli, PDO, pdo_mysql, pdo_sqlite, snmp[b]MySQL[/b] - 5.0.77 [b]RRDTool[/b] - 1.4.2 [b]SNMP[/b] - 5.3.2.2
bigear
Posts: 7
Joined: Tue Oct 31, 2006 2:07 pm

spikekill is not working.

Post by bigear »

I have added spikekill folder to my plugins and I also added $plugins[] = 'spikekill'; to my global.php.

Problem I am having is I couldn't find any sign of spikekill anywhere, not user management and Settings->Misc.

I did installed monitor plugin and it did shows up on the tab and Settings->Misc.

I am using cacti 0.8.7c and cacti-plugin-0.8.7c-PA-v2.3.

Your help is appreciated.
User avatar
TheWitness
Developer
Posts: 17059
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

This is a PIA 2.x plugin. It is installed from Plugin Management not from the global.php file.
----[ Installation

Install just like any other 2.x plugin, just throw it in the plugin directory,
in the spikekill folder and then 'Install' and 'Enable' it. Don't remember to give yourself
permission to use it.
Remember RIF!

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
bigear
Posts: 7
Joined: Tue Oct 31, 2006 2:07 pm

Post by bigear »

Thanks. I sucessfully installed spikekill from plugin management.

One of the issue I have encountered is rrd is not writable by this account.

Do you think it might have to do with rra owner is cacti and database user name is cacti user.

Your feedback is appreciated.
Attachments
spike.JPG
spike.JPG (7.49 KiB) Viewed 26797 times
User avatar
TheWitness
Developer
Posts: 17059
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

This plugin requires your web server account to have write access to the rrds.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
bigear
Posts: 7
Joined: Tue Oct 31, 2006 2:07 pm

Works!!

Post by bigear »

Thanks for your help!! It works great!!
toe_cutter
Cacti User
Posts: 168
Joined: Fri Sep 12, 2008 2:41 am
Location: Sweden

Post by toe_cutter »

Uhm, couldnt get version 1.1 to work for some reason.
The rrd in question has write access from all users. Hovered over the icon and chose all of the options from it, analyze found stuff but i couldnt understand anything of it (maybe just have: found 10 spikes above 10Mbit). Chosing Remove created an ajax popup much like the analyze one, but without the data in it.
Anyway, nothing happened to the graph :/

Code: Select all

05/27/2009 09:53:45 AM - WEBUI: Poller[0] NOTE: Removing Spikes for '/usr/local/share/cacti/rra/rostockholm1_traffic_in_2188.rrd', Method:'2'  
05/27/2009 09:53:45 AM - CMDPHP: Poller[0] /usr/local/bin/php -q /usr/local/share/cacti/plugins/spikekill/removespikes.php -R=/usr/local/share/cacti/rra/rostockholm1_traffic_in_2188.rrd -M=variance --html
Edit:
Sorry, last week at work, busybusytired. Its ofc on 0.8.7d of cacti and spine.
User avatar
TheWitness
Developer
Posts: 17059
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

Run that same command from the command line.

Larry
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
toe_cutter
Cacti User
Posts: 168
Joined: Fri Sep 12, 2008 2:41 am
Location: Sweden

Post by toe_cutter »

TheWitness wrote:Run that same command from the command line.

Larry
Sorry, but i got rid of the spikes already, used the newer (2008) removespikes.pl script from the RRDtool website.
If we get any more spikes ill be sure to try Spikekill again.

Thanks anyway.
Jason.S
Posts: 35
Joined: Thu Jun 11, 2009 9:28 am

Post by Jason.S »

I installed via the plugin manager, but I see no way to run spikekill from the interface. I see the setting under Misc, so I know it is installed.
User avatar
TheWitness
Developer
Posts: 17059
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

You must grant yourself access to it and then you kill spikes directly from the Graphs tab.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Jason.S
Posts: 35
Joined: Thu Jun 11, 2009 9:28 am

Post by Jason.S »

TheWitness wrote:This plugin requires your web server account to have write access to the rrds.

TheWitness

I am not sure what you mean by this. How would I go about setting it so I don't blow up my Cacti.
User avatar
TheWitness
Developer
Posts: 17059
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

chmod 777 /var/www/html/cacti/rra
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
mattl
Posts: 6
Joined: Mon Feb 11, 2008 11:44 am

Post by mattl »

I had an error when running spikekill 1.1. (README still shows 1.0)

Code: Select all

Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 262144 bytes) in /var/www/cacti/plugins/spikekill/removespikes.php on line 267
I got the script to run by adding this line at the beginning of removespikes.php.

Code: Select all

ini_set("memory_limit","256M");
-------

Now, I'm killing spikes. But I have a new problem. On my traffic graphs, only the Outbound spikes are eliminated, the Inbound spikes remain.

An example below. In this graph, I expect incoming and outgoing traffic to be nearly symmetrical (voip traffic). And the original graphs reflect this. After spikekill, the Outbound spikes were reduced, but the corresponding Incoming spike remained.
Image

Any tips?
Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests