(SOLVED) Upgrade Issue Cacti 1.2.19 > 1.2.21 (Error : 500 Internal Server Error)

[gene1]

Hello, having an issue upgrading from 1.2.19 > 1.2.21 with error below.

Currently running CentOS 7.9, php 7.4



cacti.log does show below logs but I am unable to derive the cause of the issue. Would appreciate advice on troubleshooting this upgrade issue.

2022/05/25 15:05:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/25 15:05:33 - INSTALL: always: Spawning background process: /bin/php '/usr/share/cacti/install/background.php' 1653462333.1739
2022/05/25 15:05:33 - INSTALL: Checking arguments
2022/05/25 15:05:33 - INSTALL: always: Setting PHP Option max_execution_time = 0
2022/05/25 15:05:33 - INSTALL: always: Setting PHP Option memory_limit = -1
2022/05/25 15:05:34 - INSTALL: always: Starting UPGRADE Process for v1.2.21
2022/05/25 15:05:34 - INSTALL: always: No tables where found or selected for conversion
2022/05/25 15:05:34 - INSTALL: always: Switched from to /tmp/cduVPgeoc
2022/05/25 15:05:34 - INSTALL: always: NOTE: Using temporary file for db cache: /tmp/cduVPgeoc
2022/05/25 15:05:34 - INSTALL: always: Upgrading from v1.2.19 (DB 1.2.21 (DB: 1.2.19)) to v1.2.20
2022/05/25 15:05:34 - INSTALL: always: Upgrading from v1.2.20 (DB 1.2.20) to v1.2.21
2022/05/25 15:05:34 - INSTALL: always: No templates were selected for import
2022/05/25 15:05:34 - INSTALL: always: Finished UPGRADE Process for v1.2.21
2022/05/25 15:05:34 - INSTALL-SYNC: always: Found 0 poller(s) to sync
2022/05/25 15:05:34 - INSTALL-SYNC: always: No Remote Data Collectors found for full syncronization
2022/05/25 15:05:34 - INSTALL: always: Installation was started at 2022-05-25 07:05:33, completed at 2022-05-25 07:05:34
2022/05/25 15:06:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.

[TheWitness]

You need to review your apache error log and your Cacti.log. The error should be there.

[gene1]

Hello, thank you for the advice. I re-ran the upgrade from 1.2.19 > 1.2.21 but still encountered the same issue.

This time I did monitor /var/log/httpd/error_log and /usr/share/cacti/log/cacti.log during installation and only noticed this error in Apache error log > PHP Fatal error: Maximum execution time of 60 seconds exceeded in /usr/share/cacti/lib/database.php

Would appreciate advice on how to troubleshoot this. Currently I am downgrading back to 1.2.19 as we are live monitoring our network.

For screenshots of the upgrade process :
https://i.ibb.co/fdW5q51/c1.png
https://i.ibb.co/JBfZz5V/c2.png
https://i.ibb.co/DV7GSCC/c3.png
https://i.ibb.co/mHHWvnc/c4.png
https://i.ibb.co/sP7dRCj/c6.png
https://i.ibb.co/Yb79htX/c5.png
https://i.ibb.co/XSYG9YC/c7.png
https://i.ibb.co/tJYkqm2/c8.png

For /var/log/httpd/error_log : (This particular error only shows during c8.png, prior to that it just hangs at c7.png for some time).

[Thu May 26 12:22:00.328702 2022] [php7:error] [pid 39115] [client XXX.XXX.XXX.XXX:1080] PHP Fatal error: Maximum execution time of 60 seconds exceeded in /usr/share/cacti/lib/database.php on line 333, referer: hxxp://XXX.XXX.XXX.XXX/cacti/install/install.php?data={%22Step%22:%2210%22,%22Eula%22:true}

For /usr/share/cacti/log/cacti.log :

2022/05/26 12:18:50 - INSTALL: always: Spawning background process: /bin/php '/usr/share/cacti/install/background.php' 1653538730.3034
2022/05/26 12:18:50 - INSTALL: Checking arguments
2022/05/26 12:18:50 - INSTALL: always: Setting PHP Option max_execution_time = 0
2022/05/26 12:18:50 - INSTALL: always: Setting PHP Option memory_limit = -1
2022/05/26 12:18:51 - INSTALL: always: Starting UPGRADE Process for v1.2.21
2022/05/26 12:18:51 - INSTALL: always: No tables where found or selected for conversion
2022/05/26 12:18:51 - INSTALL: always: Switched from to /tmp/cduDRxFFi
2022/05/26 12:18:51 - INSTALL: always: NOTE: Using temporary file for db cache: /tmp/cduDRxFFi
2022/05/26 12:18:51 - INSTALL: always: Upgrading from v1.2.19 (DB 1.2.21 (DB: 1.2.19)) to v1.2.20
2022/05/26 12:18:51 - INSTALL: always: Upgrading from v1.2.20 (DB 1.2.20) to v1.2.21
2022/05/26 12:18:51 - INSTALL: always: No templates were selected for import
2022/05/26 12:18:51 - INSTALL: always: Finished UPGRADE Process for v1.2.21
2022/05/26 12:18:51 - INSTALL-SYNC: always: Found 0 poller(s) to sync
2022/05/26 12:18:51 - INSTALL-SYNC: always: No Remote Data Collectors found for full syncronization
2022/05/26 12:18:51 - INSTALL: always: Installation was started at 2022-05-26 04:18:50, completed at 2022-05-26 04:18:51

[TheWitness]

Edit your php.ini files and set the max_execution_time = 300 and see if that fixes it. You will have to restart Apache/NGinX and php-fpo afterwards.

[gene1]

Hello, thank you for the advice. Solution by changing max_execution_time = 300 in php.ini works.

The odd issue here is our usual cacti upgrade completed in a few mins. This particular upgrade took 15 mins to complete it just hangs at certain stages of the installation similarly starting from c7.png then show the installation in progress page where it hangs again. Nevertheless upgrade completed thank you.

[TheWitness]

Upload all you final install logs.

[gene1]

Hello, install logs as per below from the point I disabled poller till I was able to gain GUI access after the upgrade to enable the poller.

2022/05/27 15:12:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:17:02 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:18:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:18:57 - INSTALL: always: Spawning background process: /bin/php '/usr/share/cacti/install/background.php' 1653635937.4213
2022/05/27 15:18:57 - INSTALL: Checking arguments
2022/05/27 15:18:57 - INSTALL: always: Setting PHP Option max_execution_time = 0
2022/05/27 15:18:57 - INSTALL: always: Setting PHP Option memory_limit = -1
2022/05/27 15:18:58 - INSTALL: always: Starting UPGRADE Process for v1.2.21
2022/05/27 15:18:58 - INSTALL: always: No tables where found or selected for conversion
2022/05/27 15:18:58 - INSTALL: always: Switched from to /tmp/cdu8J2iPT
2022/05/27 15:18:58 - INSTALL: always: NOTE: Using temporary file for db cache: /tmp/cdu8J2iPT
2022/05/27 15:18:58 - INSTALL: always: Upgrading from v1.2.19 (DB 1.2.21 (DB: 1.2.19)) to v1.2.20
2022/05/27 15:18:58 - INSTALL: always: Upgrading from v1.2.20 (DB 1.2.20) to v1.2.21
2022/05/27 15:18:58 - INSTALL: always: No templates were selected for import
2022/05/27 15:18:58 - INSTALL: always: Finished UPGRADE Process for v1.2.21
2022/05/27 15:18:58 - INSTALL-SYNC: always: Found 0 poller(s) to sync
2022/05/27 15:18:58 - INSTALL-SYNC: always: No Remote Data Collectors found for full syncronization
2022/05/27 15:18:59 - INSTALL: always: Installation was started at 2022-05-27 07:18:57, completed at 2022-05-27 07:18:59
2022/05/27 15:19:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:20:02 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:20:35 - CMDPHP Validation Error, Variable:graph_height, Value:NaN Backtrace: (/graph_json.php[46]:get_filter_request_var(), /lib/html_utility.php[508]:die_html_input_error(), /lib/html_validate.php[55]:cacti_debug_backtrace())
2022/05/27 15:21:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:22:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:23:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:24:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:25:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:25:35 - CMDPHP Validation Error, Variable:graph_height, Value:NaN Backtrace: (/graph_json.php[46]:get_filter_request_var(), /lib/html_utility.php[508]:die_html_input_error(), /lib/html_validate.php[55]:cacti_debug_backtrace())
2022/05/27 15:26:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:27:02 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:28:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:29:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:30:02 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:31:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:31:34 - CMDPHP Validation Error, Variable:graph_height, Value:NaN Backtrace: (/graph_json.php[46]:get_filter_request_var(), /lib/html_utility.php[508]:die_html_input_error(), /lib/html_validate.php[55]:cacti_debug_backtrace())
2022/05/27 15:32:01 - SYSTEM WARNING: System Polling is Disabled! Therefore, data collection from the poller will be suspended till re-enabled.
2022/05/27 15:33:01 - POLLER: Poller[1] PID[10243] WARNING: Cron is out of sync with the Poller Interval! The Poller Interval is '60' seconds, with a maximum of a '60' second Cron, but 1,320.9 seconds have passed since the last poll!
2022/05/27 15:33:01 - SYSTEM WARNING: Primary Admin account notifications disabled! Unable to send administrative Email.
2022/05/27 15:33:13 - SYSTEM STATS: Time:11.1216 Method:cmd.php Processes:1 Threads:1 Hosts:10 HostsPerProcess:10 DataSources:1093 RRDsProcessed:546
2022/05/27 15:34:10 - SYSTEM STATS: Time:9.4159 Method:cmd.php Processes:1 Threads:1 Hosts:10 HostsPerProcess:10 DataSources:1093 RRDsProcessed:546
2022/05/27 15:35:02 - AUTH LOGIN: User 'xxxxx' authenticated
2022/05/27 15:35:11 - SYSTEM STATS: Time:9.5288 Method:cmd.php Processes:1 Threads:1 Hosts:10 HostsPerProcess:10 DataSources:1093 RRDsProcessed:546
2022/05/27 15:36:10 - SYSTEM STATS: Time:9.4672 Method:cmd.php Processes:1 Threads:1 Hosts:10 HostsPerProcess:10 DataSources:1093 RRDsProcessed:546