Increasing Threads on Main Poller Causing errors

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

Post Reply
mrheavydee95
Posts: 30
Joined: Tue Mar 05, 2024 12:51 pm

Increasing Threads on Main Poller Causing errors

Post by mrheavydee95 »

I'm trying to increase the Threads on my Main Poller from 8 to 32 because my SPINE poller is timing out. I have 136 Devices on Cacti and still need to add another 120. We're running the poller every minute and I'm trying to increase the thread so the poller doesn't time out. Errors Attached.

If I throttle down the Threads back to 8, the errors go away.
Attachments
Cacti Poller Errors.png
Cacti Poller Errors.png (115.56 KiB) Viewed 1537 times
User avatar
macan
Cacti Guru User
Posts: 1137
Joined: Tue Mar 18, 2008 2:30 am
Location: Czech

Re: Increasing Threads on Main Poller Causing errors

Post by macan »

Go to utilities -> System utilities -> summary tab -> check Minimum Connections:
I think that you need increase mysql max_connection
Let the Cacti grow!
mrheavydee95
Posts: 30
Joined: Tue Mar 05, 2024 12:51 pm

Re: Increasing Threads on Main Poller Causing errors

Post by mrheavydee95 »

Thanks Macon, that did the trick.
I played around with the max_connections, join_buffer_size and sort_buffer_size and now I'm able to increase the Threads count from 8 to 40.
bmfmancini
Cacti User
Posts: 250
Joined: Wed Mar 13, 2019 3:37 pm
Location: toronto
Contact:

Re: Increasing Threads on Main Poller Causing errors

Post by bmfmancini »

40 threads is excessive!!

If anything I would lower the threads and Increase the process count

Also check for potential network issues slowing you down like a fw dropping udp thinking it's a flood
Telecom Lifer, Monitoring and performance enthusiast, Father, Husband

Cacti Bug Hunter and Member

www.seanmancini.com
sean(at)seanmancini.com
github.com/bmfmancini

My Cacti scripts and templates ( Non official)
Cacti install wizard https://github.com/bmfmancini/cacti-install-wizard
Cacti templates https://github.com/bmfmancini/Cacti-templates

Always willing to help!
Rno
Cacti Pro User
Posts: 704
Joined: Wed Dec 07, 2011 9:19 am

Re: Increasing Threads on Main Poller Causing errors

Post by Rno »

If that help, this is my system stat, and I have way more device than you:

Code: Select all

SYSTEM STATS: Time:13.9257 Method:spine Processes:8 Threads:16 Hosts:1255 HostsPerProcess:157 DataSources:22015 RRDsProcessed:0

Adding process or thread is not always the solution, and can be worst.
Test
Almalinux
php 8.2.14
mariadb 10.6.16
Cacti 1.2.27
Spine 1.2.27
RRD 1.7.2
thold 1.8
monitor 2.5
syslog 3.2
flowview: 3.3
weathermap 1.0 Beta
mrheavydee95
Posts: 30
Joined: Tue Mar 05, 2024 12:51 pm

Re: Increasing Threads on Main Poller Causing errors

Post by mrheavydee95 »

I updated my settings from 5/40 to 8/16 and the time for my poll to complete increased only 9 seconds. Thanks for the advice. Any other suggestions?

SYSTEM STATS: Time:24.1698 Method:spine Processes:5 Threads:40 Hosts:235 HostsPerProcess:47 DataSources:4219 RRDsProcessed:1562

SYSTEM STATS: Time:33.5299 Method:spine Processes:8 Threads:16 Hosts:235 HostsPerProcess:30 DataSources:4219 RRDsProcessed:1534
User avatar
TheWitness
Developer
Posts: 17047
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: Increasing Threads on Main Poller Causing errors

Post by TheWitness »

Enable boost Settings > Performance. With that many hosts, 1 process and 20 threads should be enough.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
mrheavydee95
Posts: 30
Joined: Tue Mar 05, 2024 12:51 pm

Re: Increasing Threads on Main Poller Causing errors

Post by mrheavydee95 »

What would be the best settings if I enable it. Please note that the poller is running every 1 minute.
Attachments
Cacti Performance Boost.png
Cacti Performance Boost.png (44.68 KiB) Viewed 1429 times
User avatar
TheWitness
Developer
Posts: 17047
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: Increasing Threads on Main Poller Causing errors

Post by TheWitness »

Start with the defaults. Lots of articles here on boost. Do some reading. Search using Google.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Post Reply

Who is online

Users browsing this forum: No registered users and 1 guest