DB get more and more request

Post support questions that directly relate to Linux/Unix operating systems.

Moderators: Developers, Moderators

Post Reply
thomas315
Posts: 10
Joined: Mon Nov 28, 2011 6:34 am

DB get more and more request

Post by thomas315 »

Hello,

I'm trying to upgrade our "good" old 0.8.8h cacti to 1.2.12.
This is a quite big DB (around 20k hosts with 250k DS).

The new cacti architecture is the following.
One VM for WebServer and boost (64G / 8CPU) with good IO (for rrd writing) (SSD)
One VM for DB (64G)
3 VM for remote poller (16G . 4 CPU each)
OS is Freebsd12.1

Everything is ok but after a while (generaly 8 or 12h hours), the amount of request on the main DB begins to increase, and the whole system get stuck if I don't truncate polller_output and poller_output_boost.

You'll find the following metrics below.

I've got 30k bad indexes, that i'm trying to delete, but I don't find any other ideas to deal with that issue.
Attachments
sql-poller-1.png
sql-poller-1.png (60.92 KiB) Viewed 712 times
sql-main-db.png
sql-main-db.png (77.05 KiB) Viewed 712 times
cpu-web-server-boost.png
cpu-web-server-boost.png (58.64 KiB) Viewed 712 times
cpu-poller-2.png
cpu-poller-2.png (37.69 KiB) Viewed 712 times
cpu-poller-1.png
cpu-poller-1.png (38.69 KiB) Viewed 712 times
thomas315
Posts: 10
Joined: Mon Nov 28, 2011 6:34 am

Re: DB get more and more request

Post by thomas315 »

Hello,

I haven't finish my post. But question is :
* Have you ever had this issue ?
* How can I troubleshoot ? (logs seems to be ok).

Thanks

Thomas
bmfmancini
Cacti User
Posts: 250
Joined: Wed Mar 13, 2019 3:37 pm
Location: toronto
Contact:

Re: DB get more and more request

Post by bmfmancini »

That is some odd behavior

try doing a showproccesslist in sql and see what the connections are
Are you using spine ?
Multiple pollers ?
Telecom Lifer, Monitoring and performance enthusiast, Father, Husband

Cacti Bug Hunter and Member

www.seanmancini.com
sean(at)seanmancini.com
github.com/bmfmancini

My Cacti scripts and templates ( Non official)
Cacti install wizard https://github.com/bmfmancini/cacti-install-wizard
Cacti templates https://github.com/bmfmancini/Cacti-templates

Always willing to help!
thomas315
Posts: 10
Joined: Mon Nov 28, 2011 6:34 am

Re: DB get more and more request

Post by thomas315 »

Hello,

I use spine & multipoller (main poller + 3 remote pollers).

I'll try show processlist

Thanks

Thomas
bmfmancini
Cacti User
Posts: 250
Joined: Wed Mar 13, 2019 3:37 pm
Location: toronto
Contact:

Re: DB get more and more request

Post by bmfmancini »

Oh BTW what mysql template are you using ?
Telecom Lifer, Monitoring and performance enthusiast, Father, Husband

Cacti Bug Hunter and Member

www.seanmancini.com
sean(at)seanmancini.com
github.com/bmfmancini

My Cacti scripts and templates ( Non official)
Cacti install wizard https://github.com/bmfmancini/cacti-install-wizard
Cacti templates https://github.com/bmfmancini/Cacti-templates

Always willing to help!
thomas315
Posts: 10
Joined: Mon Nov 28, 2011 6:34 am

Re: DB get more and more request

Post by thomas315 »

Hum I'dont remember exactly, I guess i got it from the web, and adapt it a litle bit, I can post the XML if neeeded.

Thomas
bmfmancini
Cacti User
Posts: 250
Joined: Wed Mar 13, 2019 3:37 pm
Location: toronto
Contact:

Re: DB get more and more request

Post by bmfmancini »

Yes please I have been looking for one
Telecom Lifer, Monitoring and performance enthusiast, Father, Husband

Cacti Bug Hunter and Member

www.seanmancini.com
sean(at)seanmancini.com
github.com/bmfmancini

My Cacti scripts and templates ( Non official)
Cacti install wizard https://github.com/bmfmancini/cacti-install-wizard
Cacti templates https://github.com/bmfmancini/Cacti-templates

Always willing to help!
Post Reply

Who is online

Users browsing this forum: No registered users and 4 guests