Cacti 0.8.6 eating diskspace

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

rosch
Posts: 14
Joined: Fri May 14, 2004 3:32 am
Location: Germany

Post by rosch »

Hi...

I have been away for a few days...
TheWitness wrote:Post a "ls -l -R" to the web site, let's see what file is growing.
I attached the output of my mysql folder. As you can see the <hostname>-bin.xxx files are the one eating space. It appears they contain logs for sql queries... What can be done to prevent this?

Roland
Attachments
ls-l-R.txt
my ls -l -R output of my /var/lib/mysql folder
(13.47 KiB) Downloaded 158 times
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
rosch
Posts: 14
Joined: Fri May 14, 2004 3:32 am
Location: Germany

Post by rosch »

But what has changed between cacti 0.8.5 and 0.8.6 that is causing now mysql to go mad?
rosch
Posts: 14
Joined: Fri May 14, 2004 3:32 am
Location: Germany

Post by rosch »

TheWitness wrote:Reading this may help.

http://dev.mysql.com/doc/mysql/en/SET_SQL_LOG_BIN.html

TheWitness
Thanks for the pointer... But, hmmm... Stupid question where shall I set this?
rosch
Posts: 14
Joined: Fri May 14, 2004 3:32 am
Location: Germany

Post by rosch »

Ok... Maybe I was a bit to fast with my last reply...

I found a
log-bin
line my /etc/my.cnf, commented it out and restarted mysql.

It appears that the log does no longer grow now...
But hmm... It was on by default from dawn of days and my database did not show that growth befor upgrading cacti to 0.8.6.

So if removing this line cures the problem it was a stupid configuration problem on the machine itself and not the fault of cacti. So I assume cacti 0.8.6 is doing much more database traffic compared to 0.8.5 which caused the growth.

Thanks for your help,

Roland
User avatar
Wernicke
Cacti User
Posts: 61
Joined: Tue Jun 08, 2004 3:07 am
Location: Bodø, Norway
Contact:

Post by Wernicke »

I have the same question. cacti's diskspace was stable before i upgraded to the latest version.. And when i check the statistic in phpmyadmin, it looks like it works constantly. Why is the SQL traffic so high?
-Sigurd
Tony

It seem mysql Innodb Problem !

Post by Tony »

I have same problem .
It seem mysql Innodb problem when I check mysql data/path (ex: /usr/loca/mysql/var)

drwx------ 2 mysql mysql 4096 Dec 8 20:08 cacti
-rw-rw---- 1 mysql mysql 119 Nov 17 20:27 Cacti-bin.001
-rw-rw---- 1 mysql mysql 4 Nov 17 20:27 Cacti-bin.002
-rw-rw---- 1 mysql mysql 79 Nov 17 20:31 Cacti-bin.003
-rw-rw---- 1 mysql mysql 79 Nov 17 21:07 Cacti-bin.004
-rw-rw---- 1 mysql mysql 79 Nov 17 21:18 Cacti-bin.005
-rw-rw---- 1 mysql mysql 4096 Dec 8 05:35 Cacti-bin.010
-rw-rw---- 1 mysql mysql 0 Dec 8 05:42 Cacti-bin.011
-rw-rw---- 1 mysql mysql 29453 Dec 8 20:59 Cacti-bin.012
-rw-rw---- 1 mysql mysql 1737145 Dec 8 21:39 Cacti-bin.013
-rw-rw---- 1 mysql mysql 100222278 Dec 10 12:21 Cacti-bin.014

any known fixes for this issue?
Tony

It is mysqlbinlog Problem !

Post by Tony »

correct:
It is mysqlbinlog Problem ! not Innodb problem.
but I don't know how to fix it.
User avatar
Wernicke
Cacti User
Posts: 61
Joined: Tue Jun 08, 2004 3:07 am
Location: Bodø, Norway
Contact:

Post by Wernicke »

btw, I use the new version of CactiD.. Perhaps it talks to much to the SQL..
Do you other ppl with the same problem use cactid?
-Sigurd
rosch
Posts: 14
Joined: Fri May 14, 2004 3:32 am
Location: Germany

Re: It seem mysql Innodb Problem !

Post by rosch »

Tony wrote:I have same problem .
It seem mysql Innodb problem when I check mysql data/path (ex: /usr/loca/mysql/var)

drwx------ 2 mysql mysql 4096 Dec 8 20:08 cacti
-rw-rw---- 1 mysql mysql 119 Nov 17 20:27 Cacti-bin.001
-rw-rw---- 1 mysql mysql 4 Nov 17 20:27 Cacti-bin.002
-rw-rw---- 1 mysql mysql 79 Nov 17 20:31 Cacti-bin.003
-rw-rw---- 1 mysql mysql 79 Nov 17 21:07 Cacti-bin.004
-rw-rw---- 1 mysql mysql 79 Nov 17 21:18 Cacti-bin.005
-rw-rw---- 1 mysql mysql 4096 Dec 8 05:35 Cacti-bin.010
-rw-rw---- 1 mysql mysql 0 Dec 8 05:42 Cacti-bin.011
-rw-rw---- 1 mysql mysql 29453 Dec 8 20:59 Cacti-bin.012
-rw-rw---- 1 mysql mysql 1737145 Dec 8 21:39 Cacti-bin.013
-rw-rw---- 1 mysql mysql 100222278 Dec 10 12:21 Cacti-bin.014

any known fixes for this issue?
I had the same problem... Switch off binary logging in your mysql conf (my.cnf). See my posting about this in this thread.
rosch
Posts: 14
Joined: Fri May 14, 2004 3:32 am
Location: Germany

Post by rosch »

Wernicke wrote:btw, I use the new version of CactiD.. Perhaps it talks to much to the SQL..
Do you other ppl with the same problem use cactid?
-Sigurd
No. I don't use cactid. I use the php poller and I also had the problems...
Now, since I switched off binary logging in mysql and deleted the <hostname>-bin.xxx files everything is fine.
User avatar
Wernicke
Cacti User
Posts: 61
Joined: Tue Jun 08, 2004 3:07 am
Location: Bodø, Norway
Contact:

Post by Wernicke »

It works fine with me too after I turned off logging.. but i think we should fix the cacti problem, not the SQL logging.. if there is a problem
-Sigurd
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

If you read about the binary log file. It logs all transactions. It's more of a debug option in MySQL. Should have been turned off from the beginning.

I believe this to be a MySQL issue. For Cacti related issues, I would look to the Apache log which holds all PHP related STDERR type output.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
rosch
Posts: 14
Joined: Fri May 14, 2004 3:32 am
Location: Germany

Post by rosch »

TheWitness wrote:If you read about the binary log file. It logs all transactions. It's more of a debug option in MySQL. Should have been turned off from the beginning.

I believe this to be a MySQL issue. For Cacti related issues, I would look to the Apache log which holds all PHP related STDERR type output.
I agree with you. Certainly it is a mysql issue in the first point. Logging should be disabled.

BUT: I would also be nice to know why cacti 0.8.5 was not causing a so tremendous increase of the logfile and 0.8.6 is doing this now. In bigger scenarios when monitoring much more than my 20 hosts here sql traffic could become a performance issue.
User avatar
Wernicke
Cacti User
Posts: 61
Joined: Tue Jun 08, 2004 3:07 am
Location: Bodø, Norway
Contact:

Post by Wernicke »

Here's the statistic from phpmyadmin:(This is statistic for 1 day with 110 hosts)

Query statistics: Since its startup, 3,816,588 queries have been sent to the server.
Total ø per hour ø per minute ø per second
3,816,588 100,460.03 1,674.33 27.91



28 per second :o ? Cheeses
-Sigurd
Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests