Clicking Log Tab rockets CPU cacti 1.2.21

[irodriguez]

Hello.

When I click the Log Tab CPU reaches 100% php-fpm 30% and mysqld 70%. After 60 seconds appears this window. However CPU keeps 100% during 3 or 4 minutes.
There is no warning in the Console->Utilities->Technical Support MariaDB tunning section

version 10.3.32-MariaDB >= 5.6
collation_server utf8mb4_unicode_ci = utf8mb4_unicode_ci
character_set_server utf8mb4 = utf8mb4
character_set_client utf8mb4 = utf8mb4
max_connections 151 >= 100
max_allowed_packet 16777216 >= 16777216
max_heap_table_size 64 M >= 56.88 M
tmp_table_size 64 M >= 56.88 M
join_buffer_size 128 M >= 113.77 M
innodb_file_per_table ON = ON
innodb_file_format Barracuda = Barracuda
innodb_large_prefix 1 = 1
innodb_buffer_pool_size 1024 M >= 888.82 M
innodb_doublewrite OFF = OFF
innodb_lock_wait_timeout 50 >= 50
innodb_flush_method fsync eq O_DIRECT
innodb_flush_log_at_timeout 3 >= 3
innodb_read_io_threads 32 >= 32
innodb_write_io_threads 16 >= 16
innodb_buffer_pool_instances 9 >= 9
innodb_io_capacity 5000 >= 5000
innodb_io_capacity_max 10000 >= 10000
innodb_use_atomic_writes ON = ON


Any help?

[TheWitness]

How big is the cacti.log file?

[irodriguez]

-rw-r--r-- 1 apache apache 302M Jul 22 20:13 cacti.log

[TheWitness]

You might want to split it or increase you memory_limit in php.ini to over a gig.

[TheWitness]

You have to restart apache afterwards.

[irodriguez]

Hello,

memory_limit already was 800M. I changed it to 1.6G and nothing changed.
I still have my previous cacti version 1.2.14 running in the old server, 1 CPU and 2 GB of RAM, and I copied the cacti.log (320 MB aprox) from the new server to the old one and I can see logs in the Log tab of Cacti GUI of the old server in 10 seconds.
Main differences between servers are:
- The old server is running mariaDB 5.5.68 and the new server is running mariaDB 10.3.32
- The old server is not running php-fpm
- The old server has 1 CPU and 2 GB of RAM and the new server 2 CPU and 4 GB of RAM

I tried to disable PHP-FPM in the new server but the problem continues.

Maybe there is something wrong with mariaDB 10.3.32 that doesn't get a good performance.
When I click on the log tab of the old Cacti server, if I monitor CPU with top, I only see a 10 seconds peak of 40% of httpd and a 1 second peak of 10% of mysqld.

Regards

[TheWitness]

Can you switch to the 1.2.x branch? I made some caching changes there.

[irodriguez]

I don't understand. I'm using 1.2.21 in the new server and 1.2.14 in the old one. Both are 1.2.x branch, aren't they?

Regards

[TheWitness]

The change was after 1.2.21. The 1.2.x branch is the active development branch. It's several commit's ahead of 1.2.21.


1.2.22
-security#4834: XSS Issue in graphs_new.php
-issue#4768: Multiple AD LDAP Full Name and mail are not propagated when creating user from template
-issue#4802: Typo in lib/auth.php prevents users from changing their password and logging in
-issue#4808: WARNING: Poller Output Table not Empty
-issue#4810: Call to undefined function boost_debug in Cacti log
-issue#4791: Nectar Aggregate 95th emailed report broken
-issue#4796: Hint at poller issues when boost fails
-issue#4803: Net-SNMP Memory Graph Template has Wrong GPRINT
-issue#4806: Search in tree view unusable on sizeable installations
-issue#4814: When no guest template is set, login cookies are not properly set
-issue#4817: Boost when using RRDtool 1.5+ does not need to check last_update time
-issue#4818: Regex widths are too narrow
-issue#4819: Domains based LDAP and AD Fullname and Email not auto-populated
-issue#4822: Cacti polling and boost report the wrong number of Data Sources when Devices are disabled
-issue#4823: When editing Graph Template Items there are cases where VDEF's are hidden when they should be shown
-issue#4831: Cactid lacks a default for $database_ssl
-issue#4837: Add correct path for spine in *BSD systems
-issue#4840: Web Basic authentication not creating template user
-issue#4846: Unable to change the Heartbeat of a Data Source Profile
-issue#4849: Tree Search does not properly search all Trees
-issue#4850: When structured paths are setup even if the web server has write access it won't create RRDfiles
-issue#4851: Too Many Turns on Log Parsing
-issue#4853: Deprecation warnings when attempting real-time Graphs with PHP8.1
-issue#4860: Custom Timespan is lost when clicking other tree branches
-issue#4863: Non device based Data Sources not being polled
-issue#4865: XML Pre-processing during Graph Creation throws error when Resource XML file inproperly formatted
-issue#4866: Using ${var} in strings is deprecated, use {$var} instead in file
-issue#4867: In Graph Management, filtering for "Device: None" shows all graphs
-issue#4871: Realtime popup window experiences issues on some browsers
-feature#4820: Make it possible to only import certain components when importing packages
-feature#4825: Add update_device.php script to cli folder
-feature#4827: Move all Help pages to docs.cacti.net if the page is reachable
-feature#4832: Show PHP INI locations during install
-feature#4833: Detect PHP INI values that are different in the INI vs running config
-feature#4870: Add gradient support for AREA charts
-feature#4872: Add missing and more recent CDEF functions for RRDtool

[TheWitness]

Take note of this one.

-issue#4851: Too Many Turns on Log Parsing

Also, I'm curious, you copied the 320MB log file to the other server and it came up well?

[irodriguez]

That's right. The old server processed perfectly the 320MB cactus.log file when I accessed from the log tab of the GUI.

Regards