Spikekill 1.0 - Released
Moderators: Developers, Moderators
- TheWitness
- Developer
- Posts: 17059
- Joined: Tue May 14, 2002 5:08 pm
- Location: MI, USA
- Contact:
Spikekill 1.0 - Released
All,
It's been a while since there was a good spike killer for Cacti. Attached please find my latest work. It is a much more advanced Spike Killer than Alice's. It uses my own design to ferret out the Spikes from an RRDfile and remove them.
There are several options. So make sure you goto Settings->Misc and check them out. It uses one of two methods to remove spikes. There is Standard Deviation and Variance.
The Standard Deviation removes anything that is over X Standard Deviations above or below the Average. The Variance, will take away X outliers both above and below the average and then remove anything that is greater than X% above the Variance Average.
You have the ability to replace the Spike Value with either an NaN or the Average of that RRA period. You also have the ability to perform Dryrun's before you actually execute the Spike Removal. Please do so in order to "tweak" the install before running it.
The command also works from the command line and equally works even if you don't have Cacti!!!
I am looking for specific feedback on this feature and look forward to that.
Regards,
TheWitness
It's been a while since there was a good spike killer for Cacti. Attached please find my latest work. It is a much more advanced Spike Killer than Alice's. It uses my own design to ferret out the Spikes from an RRDfile and remove them.
There are several options. So make sure you goto Settings->Misc and check them out. It uses one of two methods to remove spikes. There is Standard Deviation and Variance.
The Standard Deviation removes anything that is over X Standard Deviations above or below the Average. The Variance, will take away X outliers both above and below the average and then remove anything that is greater than X% above the Variance Average.
You have the ability to replace the Spike Value with either an NaN or the Average of that RRA period. You also have the ability to perform Dryrun's before you actually execute the Spike Removal. Please do so in order to "tweak" the install before running it.
The command also works from the command line and equally works even if you don't have Cacti!!!
I am looking for specific feedback on this feature and look forward to that.
Regards,
TheWitness
- Attachments
-
- spikekill-1.0-2.tar.gz
- Now working for Linux/UNIX
- (34.68 KiB) Downloaded 1783 times
-
- spikekill-1.0-1.tar.gz
- Works fine with Windows
- (34.63 KiB) Downloaded 655 times
Last edited by TheWitness on Mon Mar 02, 2009 10:03 pm, edited 1 time in total.
True understanding begins only when we realize how little we truly understand...
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Disregard. I found the problem and fixed it. It works great now
[b]Cacti Version[/b] - 0.8.7d [b]Plugin Architecture[/b] - 2.4 [b]Poller Type[/b] - CMD.php [b]Server Info[/b] - Linux 2.6.18-164.9.1.el5 [b]Web Server[/b] - Apache/2.2.3 (CentOS) [b]PHP[/b] - 5.1.6 [b]PHP Extensions[/b] - libxml, xml, wddx, tokenizer, sysvshm, sysvsem, sysvmsg, standard, SimpleXML, sockets, SPL, shmop, session, Reflection, pspell, posix, mime_magic, iconv, hash, gmp, gettext, ftp, exif, date, curl, ctype, calendar, bz2, zlib, pcre, openssl, apache2handler, dbase, gd, mysql, mysqli, PDO, pdo_mysql, pdo_sqlite, snmp[b]MySQL[/b] - 5.0.77 [b]RRDTool[/b] - 1.4.2 [b]SNMP[/b] - 5.3.2.2
spikekill is not working.
I have added spikekill folder to my plugins and I also added $plugins[] = 'spikekill'; to my global.php.
Problem I am having is I couldn't find any sign of spikekill anywhere, not user management and Settings->Misc.
I did installed monitor plugin and it did shows up on the tab and Settings->Misc.
I am using cacti 0.8.7c and cacti-plugin-0.8.7c-PA-v2.3.
Your help is appreciated.
Problem I am having is I couldn't find any sign of spikekill anywhere, not user management and Settings->Misc.
I did installed monitor plugin and it did shows up on the tab and Settings->Misc.
I am using cacti 0.8.7c and cacti-plugin-0.8.7c-PA-v2.3.
Your help is appreciated.
- TheWitness
- Developer
- Posts: 17059
- Joined: Tue May 14, 2002 5:08 pm
- Location: MI, USA
- Contact:
This is a PIA 2.x plugin. It is installed from Plugin Management not from the global.php file.
TheWitness
Remember RIF!----[ Installation
Install just like any other 2.x plugin, just throw it in the plugin directory,
in the spikekill folder and then 'Install' and 'Enable' it. Don't remember to give yourself
permission to use it.
TheWitness
True understanding begins only when we realize how little we truly understand...
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Thanks. I sucessfully installed spikekill from plugin management.
One of the issue I have encountered is rrd is not writable by this account.
Do you think it might have to do with rra owner is cacti and database user name is cacti user.
Your feedback is appreciated.
One of the issue I have encountered is rrd is not writable by this account.
Do you think it might have to do with rra owner is cacti and database user name is cacti user.
Your feedback is appreciated.
- Attachments
-
- spike.JPG (7.49 KiB) Viewed 26795 times
- TheWitness
- Developer
- Posts: 17059
- Joined: Tue May 14, 2002 5:08 pm
- Location: MI, USA
- Contact:
This plugin requires your web server account to have write access to the rrds.
TheWitness
TheWitness
True understanding begins only when we realize how little we truly understand...
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
-
- Cacti User
- Posts: 168
- Joined: Fri Sep 12, 2008 2:41 am
- Location: Sweden
Uhm, couldnt get version 1.1 to work for some reason.
The rrd in question has write access from all users. Hovered over the icon and chose all of the options from it, analyze found stuff but i couldnt understand anything of it (maybe just have: found 10 spikes above 10Mbit). Chosing Remove created an ajax popup much like the analyze one, but without the data in it.
Anyway, nothing happened to the graph :/
Edit:
Sorry, last week at work, busybusytired. Its ofc on 0.8.7d of cacti and spine.
The rrd in question has write access from all users. Hovered over the icon and chose all of the options from it, analyze found stuff but i couldnt understand anything of it (maybe just have: found 10 spikes above 10Mbit). Chosing Remove created an ajax popup much like the analyze one, but without the data in it.
Anyway, nothing happened to the graph :/
Code: Select all
05/27/2009 09:53:45 AM - WEBUI: Poller[0] NOTE: Removing Spikes for '/usr/local/share/cacti/rra/rostockholm1_traffic_in_2188.rrd', Method:'2'
05/27/2009 09:53:45 AM - CMDPHP: Poller[0] /usr/local/bin/php -q /usr/local/share/cacti/plugins/spikekill/removespikes.php -R=/usr/local/share/cacti/rra/rostockholm1_traffic_in_2188.rrd -M=variance --html
Sorry, last week at work, busybusytired. Its ofc on 0.8.7d of cacti and spine.
- TheWitness
- Developer
- Posts: 17059
- Joined: Tue May 14, 2002 5:08 pm
- Location: MI, USA
- Contact:
Run that same command from the command line.
Larry
Larry
True understanding begins only when we realize how little we truly understand...
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
-
- Cacti User
- Posts: 168
- Joined: Fri Sep 12, 2008 2:41 am
- Location: Sweden
- TheWitness
- Developer
- Posts: 17059
- Joined: Tue May 14, 2002 5:08 pm
- Location: MI, USA
- Contact:
You must grant yourself access to it and then you kill spikes directly from the Graphs tab.
TheWitness
TheWitness
True understanding begins only when we realize how little we truly understand...
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
- TheWitness
- Developer
- Posts: 17059
- Joined: Tue May 14, 2002 5:08 pm
- Location: MI, USA
- Contact:
chmod 777 /var/www/html/cacti/rra
True understanding begins only when we realize how little we truly understand...
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
I had an error when running spikekill 1.1. (README still shows 1.0)
I got the script to run by adding this line at the beginning of removespikes.php.
-------
Now, I'm killing spikes. But I have a new problem. On my traffic graphs, only the Outbound spikes are eliminated, the Inbound spikes remain.
An example below. In this graph, I expect incoming and outgoing traffic to be nearly symmetrical (voip traffic). And the original graphs reflect this. After spikekill, the Outbound spikes were reduced, but the corresponding Incoming spike remained.
Any tips?
Code: Select all
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 262144 bytes) in /var/www/cacti/plugins/spikekill/removespikes.php on line 267
Code: Select all
ini_set("memory_limit","256M");
Now, I'm killing spikes. But I have a new problem. On my traffic graphs, only the Outbound spikes are eliminated, the Inbound spikes remain.
An example below. In this graph, I expect incoming and outgoing traffic to be nearly symmetrical (voip traffic). And the original graphs reflect this. After spikekill, the Outbound spikes were reduced, but the corresponding Incoming spike remained.
Any tips?
Who is online
Users browsing this forum: No registered users and 2 guests