Remove peaks from rrd file : spikekill

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

Post Reply
alex4ever
Posts: 5
Joined: Thu Jun 11, 2009 10:25 am

Remove peaks from rrd file : spikekill

Post by alex4ever »

Hi

I have a rrdfile with a peak of 200Petabytes -150Petabytes.
Spikekill not remove the peak

Do you know how can I remove it?

I've attached the rrdfile

Thanks a lot

alex
Attachments
Peak.rrd.gz
RRD File with a Peak 200P/-150P PetaBytes
(259.44 KiB) Downloaded 340 times
alex4ever
Posts: 5
Joined: Thu Jun 11, 2009 10:25 am

Post by alex4ever »

Hi

Here are the steps a followed.

1.- $ php removespikes.php -R=/tmp/Peak.rrd -D
NOTE: Creating XML file '/tmp/Peak.dump.789301538' from '/tmp/Peak.rrd'
NOTE: Searching for Spikes in XML file '/tmp/Peak.dump.789301538'

Size DataSource CF Samples NonNan Avg StdDev MaxValue MinValue MaxStdDev MinStdDev StdKilled VarKilled StdDevAvg VarAvg
---------- --------------- ---------- ------- ------- ---------- ---------- ---------- ---------- ---------- ---------- ---------- ---------- ---------- ----------
1 mins 1 AVERAGE 2880 2880 4017.92 1296.19 6808.22 279.02 0 0 2880 0 0 4019.57
1 mins 2 AVERAGE 2880 2880 1.0675e+14 1.4757e+15 2.1207e+16 47272.38 0 0 2880 0 0 7.0178e+13
1 mins 3 AVERAGE 2880 2880 1.0675e+14 1.4757e+15 2.1207e+16 155115.33 0 0 2880 0 0 7.0178e+13
5 mins 1 AVERAGE 2880 2880 4298.95 1968.21 19055.67 279.02 0 0 2880 0 0 4280.23
5 mins 2 AVERAGE 2880 2880 5.1507e+12 2.4354e+14 1.3026e+16 45601.31 0 0 2880 4 0 529250.82
5 mins 3 AVERAGE 2880 2880 1.2514e+13 4.6404e+14 2.1207e+16 116897.28 0 0 2880 5 0 1.2154e+6
30 mins 1 AVERAGE 4320 2334 4341.87 1568.51 17491.61 1271.82 0 0 2334 0 0 4328.24
30 mins 2 AVERAGE 4320 2334 125479.38 466050.87 1.2424e+7 4292.93 0 0 2334 0 0 110609.73
30 mins 3 AVERAGE 4320 2334 778205.07 483791.58 3.7777e+6 51054.9 0 0 2334 0 0 774170.84
6 hours 1 AVERAGE 5840 194 4357.31 1260.78 8338.07 1693.41 0 0 194 0 0 4337.21
6 hours 2 AVERAGE 5840 194 124941.11 279422.54 3.4482e+6 7176.53 0 0 194 0 0 95845.26
6 hours 3 AVERAGE 5840 194 775731.94 412899.89 1.9937e+6 110291.01 0 0 194 0 0 768786.42
1 mins 1 MAX 2880 2880 4017.92 1296.19 6808.22 279.02 0 0 2880 0 0 4019.57
1 mins 2 MAX 2880 2880 1.0675e+14 1.4757e+15 2.1207e+16 47272.38 0 0 2880 0 0 7.0178e+13
1 mins 3 MAX 2880 2880 1.0675e+14 1.4757e+15 2.1207e+16 155115.33 0 0 2880 0 0 7.0178e+13
5 mins 1 MAX 2880 2880 4448.1 2083.71 19055.67 279.02 0 0 2880 0 0 4429.07
5 mins 2 MAX 2880 2880 8.1484e+12 3.9583e+14 2.1207e+16 45601.31 0 0 2880 7 0 667665.09
5 mins 3 MAX 2880 2880 1.5512e+13 5.5916e+14 2.1207e+16 116897.28 0 0 2880 5 0 1.3206e+6
30 mins 1 MAX 4320 2334 5283.32 2280.74 21919.48 1465.59 0 0 2334 0 0 5256.93
30 mins 2 MAX 4320 2334 212859.28 944905.75 1.5247e+7 4487.39 0 0 2334 0 0 183260.5
30 mins 3 MAX 4320 2334 853236.78 596015.22 6.3365e+6 62322.4 0 0 2334 0 0 844073.03
6 hours 1 MAX 5840 194 7875.66 3956.55 21919.48 2936.36 0 0 194 0 0 7648.93
6 hours 2 MAX 5840 194 685203.35 1.8034e+6 1.5247e+7 13714.19 0 0 194 0 0 499478.5
6 hours 3 MAX 5840 194 1.2624e+6 980071.45 6.3365e+6 238562.54 0 0 194 0 0 1.1740e+6
1 mins 1 MIN 2880 2880 4017.92 1296.19 6808.22 279.02 0 0 2880 0 0 4019.57
1 mins 2 MIN 2880 2880 1.0675e+14 1.4757e+15 2.1207e+16 47272.38 0 0 2880 0 0 7.0178e+13
1 mins 3 MIN 2880 2880 1.0675e+14 1.4757e+15 2.1207e+16 155115.33 0 0 2880 0 0 7.0178e+13
5 mins 1 MIN 2880 2880 4146.27 1907.62 19055.67 279.02 0 0 2880 0 0 4127.58
5 mins 2 MIN 2880 2880 294819.38 1.0472e+6 1.5247e+7 45601.31 0 0 2880 0 0 270396.82
5 mins 3 MIN 2880 2880 1.0090e+6 599728.03 5.8531e+6 116897.28 0 0 2880 0 0 1.0025e+6
30 mins 1 MIN 4320 2334 3573.41 1322.67 13190.45 279.02 0 0 2334 0 0 3562.76
30 mins 2 MIN 4320 2334 68485.23 150840.35 6.7116e+6 4069.51 0 0 2334 0 0 64209.51
30 mins 3 MIN 4320 2334 718737.13 448317.67 2.1702e+6 41322.15 0 0 2334 0 0 717372.51
6 hours 1 MIN 5840 194 2573.42 936.77 4962.96 279.02 0 0 194 0 0 2558.59
6 hours 2 MIN 5840 194 43496.93 29923.58 132209.11 4069.51 0 0 194 0 0 42452.79
6 hours 3 MIN 5840 194 410742.21 348942.52 1.6304e+6 41322.15 0 0 194 0 0 392815.27

NOTE: Dryrun requested. No updates performed

Spikekill detect speaks on the graph

2.- Now I run without -D to update the rrd file

$ php removespikes.php -R=/tmp/Peak.rrd
NOTE: Creating XML file '/tmp/Peak.dump.811103963' from '/tmp/Peak.rrd'
NOTE: Searching for Spikes in XML file '/tmp/Peak.dump.811103963'
NOTE: Backing Up '/tmp/Peak.rrd' to '/tmp/Peak.rrd.811103963'
NOTE: Re-Importing '/tmp/Peak.dump.811103963' to '/tmp/Peak.rrd'

3.- Test with -D if peaks go out, but the output its the same as step 1

$ php removespikes.php -R=/tmp/Peak.rrd -D
NOTE: Creating XML file '/tmp/Peak.dump.1055922511' from '/tmp/Peak.rrd'
NOTE: Searching for Spikes in XML file '/tmp/Peak.dump.1055922511'

Size DataSource CF Samples NonNan Avg StdDev MaxValue MinValue MaxStdDev MinStdDev StdKilled VarKilled StdDevAvg VarAvg
---------- --------------- ---------- ------- ------- ---------- ---------- ---------- ---------- ---------- ---------- ---------- ---------- ---------- ----------
1 mins 1 AVERAGE 2880 2880 4018.76 1295.79 6808.22 279.02 0 0 2880 0 0 4020.41
1 mins 2 AVERAGE 2880 2880 1.0683e+14 1.4757e+15 2.1207e+16 47272.38 0 0 2880 0 0 7.0253e+13
1 mins 3 AVERAGE 2880 2880 1.0679e+14 1.4757e+15 2.1207e+16 155115.33 0 0 2880 0 0 7.0215e+13
5 mins 1 AVERAGE 2880 2880 4300.01 1967.69 19055.67 279.02 0 0 2880 0 0 4281.29
5 mins 2 AVERAGE 2880 2880 5.1543e+12 2.4354e+14 1.3026e+16 45601.31 0 0 2880 6 0 1.7953e+9
5 mins 3 AVERAGE 2880 2880 1.2519e+13 4.6404e+14 2.1207e+16 116897.28 0 0 2880 6 0 4.3616e+9
30 mins 1 AVERAGE 4320 2334 4341.86 1568.51 17491.61 1271.82 0 0 2334 0 0 4328.24
30 mins 2 AVERAGE 4320 2334 125484.3 466050.84 1.2424e+7 4292.93 0 0 2334 0 0 110614.67
30 mins 3 AVERAGE 4320 2334 778206.36 483791.57 3.7777e+6 51054.9 0 0 2334 0 0 774172.14
6 hours 1 AVERAGE 5840 194 4357.22 1260.78 8338.07 1693.41 0 0 194 0 0 4337.13
6 hours 2 AVERAGE 5840 194 125010.09 279421.7 3.4482e+6 7176.53 0 0 194 0 0 95918
6 hours 3 AVERAGE 5840 194 775755.3 412899.76 1.9937e+6 110291.01 0 0 194 0 0 768811.05
1 mins 1 MAX 2880 2880 4018.76 1295.79 6808.22 279.02 0 0 2880 0 0 4020.41
1 mins 2 MAX 2880 2880 1.0683e+14 1.4757e+15 2.1207e+16 47272.38 0 0 2880 0 0 7.0253e+13
1 mins 3 MAX 2880 2880 1.0679e+14 1.4757e+15 2.1207e+16 155115.33 0 0 2880 0 0 7.0215e+13
5 mins 1 MAX 2880 2880 4449.27 2083.14 19055.67 279.02 0 0 2880 0 0 4430.24
5 mins 2 MAX 2880 2880 8.1541e+12 3.9583e+14 2.1207e+16 45601.31 0 0 2880 6 0 2.8400e+9
5 mins 3 MAX 2880 2880 1.5517e+13 5.5916e+14 2.1207e+16 116897.28 0 0 2880 6 0 5.4062e+9
30 mins 1 MAX 4320 2334 5283.31 2280.74 21919.48 1465.59 0 0 2334 0 0 5256.92
30 mins 2 MAX 4320 2334 212870.33 944905.68 1.5247e+7 4487.39 0 0 2334 0 0 183271.6
30 mins 3 MAX 4320 2334 853238.96 596015.22 6.3365e+6 62322.4 0 0 2334 0 0 844075.22
6 hours 1 MAX 5840 194 7875.25 3956.55 21919.48 2936.36 0 0 194 0 0 7648.5
6 hours 2 MAX 5840 194 685846.94 1.8034e+6 1.5247e+7 13714.19 0 0 194 0 0 500157.07
6 hours 3 MAX 5840 194 1.2625e+6 980069.24 6.3365e+6 238562.54 0 0 194 0 0 1.1741e+6
1 mins 1 MIN 2880 2880 4018.76 1295.79 6808.22 279.02 0 0 2880 0 0 4020.41
1 mins 2 MIN 2880 2880 1.0683e+14 1.4757e+15 2.1207e+16 47272.38 0 0 2880 0 0 7.0253e+13
1 mins 3 MIN 2880 2880 1.0679e+14 1.4757e+15 2.1207e+16 155115.33 0 0 2880 0 0 7.0215e+13
5 mins 1 MIN 2880 2880 4147.75 1906.78 19055.67 279.02 0 0 2880 0 0 4129.08
5 mins 2 MIN 2880 2880 294981.62 1.0472e+6 1.5247e+7 45601.31 0 0 2880 0 0 270559.63
5 mins 3 MIN 2880 2880 1.0092e+6 599577.69 5.8531e+6 116897.28 0 0 2880 0 0 1.0027e+6
30 mins 1 MIN 4320 2334 3573.4 1322.67 13190.45 279.02 0 0 2334 0 0 3562.76
30 mins 2 MIN 4320 2334 68485.85 150840.35 6.7116e+6 4069.51 0 0 2334 0 0 64210.13
30 mins 3 MIN 4320 2334 718737.75 448317.67 2.1702e+6 41322.15 0 0 2334 0 0 717373.13
6 hours 1 MIN 5840 194 2573.43 936.77 4962.96 279.02 0 0 194 0 0 2558.61
6 hours 2 MIN 5840 194 43501.85 29923.54 132209.11 4069.51 0 0 194 0 0 42457.98
6 hours 3 MIN 5840 194 410760.04 348942.43 1.6304e+6 41322.15 0 0 194 0 0 392834.07

NOTE: Dryrun requested. No updates performed

Do you what I'm doing bad ?

Thanks
alex4ever
Posts: 5
Joined: Thu Jun 11, 2009 10:25 am

Post by alex4ever »

Hi

Do you know how can I remove the peaks in the graph ?

There is other tool to do it ?

Thanks
mcutting
Cacti Guru User
Posts: 1884
Joined: Mon Oct 16, 2006 5:57 am
Location: United Kingdom
Contact:

Post by mcutting »

There is a spike kill plugin in the forums.

Here you go http://forums.cacti.net/viewtopic.php?t=31420

EDIT - Just re-read your original post. Might be best to ask someone like Gandalf
Cacti Version 0.8.8b
Cacti OS Ubuntu LTS
RRDTool Version RRDTool 1.4.7
Poller Information
Type SPINE 0.8.8b
alex4ever
Posts: 5
Joined: Thu Jun 11, 2009 10:25 am

Post by alex4ever »

Hi mcutting

This is the plugin I'm using (spikekill version 1.1) download from

http://docs.cacti.net/plugin:spikekill

With the removespikes.php inside the plugin I can't remove the peaks as you can see in the ouput above

Spikekill work fine for you !!

Thanks a lot
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

You should investigate how to use this plugin by using the --help option and discovering when it will remove spikes. I would prefer to see your output in MONOSPACE, or a screen capture while using the plugin from the web site. What you posted is somewhat hard to discern.

After you read the documentation, you should choose the method best for you to remove the spikes. There is Standard Deviation and Variance as options.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
alex4ever
Posts: 5
Joined: Thu Jun 11, 2009 10:25 am

Post by alex4ever »

Hi

Today spikekill remove the peaks from the graph.

I've ran the plugin some times until the final results.

Thanks very much for your help

Great plugin
Attachments
Graph with peak
Graph with peak
Picture 1.png (16.84 KiB) Viewed 9987 times
Graph withou peak. Perfect
Graph withou peak. Perfect
Picture 2.png (45.81 KiB) Viewed 9987 times
mcutting
Cacti Guru User
Posts: 1884
Joined: Mon Oct 16, 2006 5:57 am
Location: United Kingdom
Contact:

Post by mcutting »

Nice graph - care to post your template etc for this in the Scripts / Templates forum ?

Thanks
Cacti Version 0.8.8b
Cacti OS Ubuntu LTS
RRDTool Version RRDTool 1.4.7
Poller Information
Type SPINE 0.8.8b
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Post by gandalf »

If I'm not mistaken, I already posted a very similar set of templates to the repository
Reinhard
Babel
Posts: 29
Joined: Sat Feb 07, 2009 8:05 am

Fatal: File /cacti-web/xxxx.rrd is not writable for this acc

Post by Babel »

Help me please resolve a problem.
when I try to remove or analyze graph with spike kill plugin I get message Fatal: File /cacti-web/xxxx.rrd is not writable by this account

All files have permissions
-rw-r--r-- 1 cacti cacti xxxx.rrd

in cacti systems i have administrative permissions.
What doesn't right?
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

Code: Select all

chmod -R 777 /var/www/html/cacti/rra
T
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Babel
Posts: 29
Joined: Sat Feb 07, 2009 8:05 am

Post by Babel »

nothing to change
I change permissions but get error such as last time
What does meaning "by this account"?
account at server or in cacti systems.
May be I must change some options in the plugin

Now i have installed
Cacti Version: 0.8.7c
Plugin Architecture Version: 2.3
spikekill 1.0
settings 0.5
thold 0.3.9
Babel
Posts: 29
Joined: Sat Feb 07, 2009 8:05 am

Post by Babel »

from a command line all works fine
# php removespikes.php --rrdfile=/cacti-web/rra/traffic_in_8600.rrd --method=variance --backup
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

Simply confirm permissions are 777. If they are, its likely an APACHE config option that I am not aware of.

L
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
izmenoff
Posts: 19
Joined: Tue Mar 28, 2017 6:27 am
Location: Belarus

Re:

Post by izmenoff »

Hello!
Why cacti show spikekill only for 6 hours?

Image
Image
Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests