totalling 22 Data Sources. Please Either Re-Index, Delete or[solved]

[majed17]

Peace, it has been a while since i added a host to cacti, so when i did on version 1.2.5, it started nagging that:
totalling 22 Data Sources. Please Either Re-Index, Delete or Disable these Data Sources
so i went to console, management and data sources and selected bad indexes and went to graph management and deleted the offending graphs, but then i discovered that the new host replaced the graphs of another host, so i tried recreating the graphs for the other host but then it happened to a third host. i tried running the reindex poller but that didn't help. Also i noticed that the log files are 3 hours behind, so i restarted apache and cron and the log time went correct for less than 5 minutes and then lagged back to 3 hours, although the time in graphing is correct, the date on linux is correct. what to do?
this is what happened when i reindexed,

Code: Select all

CMDPHP PHP ERROR WARNING Backtrace: (/cli/poller_reindex_hosts.php[141]:run_data_query(), /lib/data_query.php[106]:query_snmp_host(), /lib/data_query.php[727]:get_best_data_query_index_type(), /lib/data_query.php[2029]:sizeof(), CactiErrorHandler()

[Osiris]

Update to develop, and then re-index again. Some of these may be real. After re-index, go-to data sources and select orphans to get more info on the data sources.

[majed17]

i installed cacti develop and spine develop, and it didn't present an upgrade script, just stayed 1.2.5.
reindexing showed the following error

Code: Select all

..PHP Notice:  Undefined index: fields in /var/www/localhost/htdocs/cacti/lib/data_query.php on line 2029
PHP Warning:  sizeof(): Parameter must be an array or an object that implements Countable in /var/www/localhost/htdocs/cacti/lib/data_query.php on line 202

[majed17]

so nothing else can be done? the log date error was because the apache-cli php.ini file didn't have the time.zone defined in it

[Osiris]

I think that last issue has just been fixed.

[majed17]

it is on github, and i tried the fix unsuccessfully..

[Osiris]

You have to grab from branch 1.2.x and not develop.

[majed17]

so i've been advised but i couldn't find it, sorry

[netniV]

https://github.com/Cacti/cacti/tree/1.2.x

[majed17]

so after battling with missing xml file for router memory, i finally managed to reindex the indexes and the ones that were causing the problems are gone, but now it is not graphing, even though i restarted mysql, apache2, vixie-cron, several times, must be because i'm on cacti 1.2.6 and spine 1.2.5, the log shows:

Code: Select all

2019/08/14 09:35:00 - POLLER: Poller[Main Poller] Maximum runtime of 298 seconds exceeded. Exiting. 

[netniV]

Up your debugging level so you can see what is being polled and how long things are taking. The chances are you have a timeout issue occurring with a high timeout value resulting in the overrun. For example, if you have 1 minute polling, but set the timeout on everything to 5 seconds, that 5 seconds, then any device outage could wait hit that timeout one or more times (especially if you have uptime set as ping or snmp).

[majed17]

and how to do that?
i enabled devel developer debugging and in the poller detailed.. but it is still only produces 3 lines like before, must i restart something?

[majed17]

i canged to medium and this what i get :

Code: Select all

POLLER: Poller[Main Poller] NOTE: Poller Int: '300', Cron Int: '300', Time Since Last: '300.72', Max Runtime '298', Poller Runs: '1' 

[netniV]

No, you just want the standard logging level increased, not the developer debug one as that's more for looking into MySQL issues.

You may need to increase it again from Medium but I would have thought you would have seen at least something more.

[majed17]

i have poller interval 5 min, cron 5 min, poller sync 2hours., i increased the timeout to 20secs and still no graphing..
here is the log:

Code: Select all

2019/08/14 15:40:12 - WEBUI Found Valid 'Graph Template' priming cache
2019/08/14 15:40:12 - WEBUI Fetch InitRows:-1, Hash:1597d7f033a83a19f5b1a2356ce08ea0
2019/08/14 15:40:12 - WEBUI Obtaining 'Graph Template' cache
2019/08/14 15:40:01 - POLLER: Poller[Main Poller] NOTE: Poller Int: '300', Cron Int: '300', Time Since Last: '300.61', Max Runtime '298', Poller Runs: '1'
2019/08/14 15:40:00 - REPORTS Cacti Reports reports found: 0
2019/08/14 15:40:00 - SYSTEM STATS: Time:298.6046 Method:spine Processes:1 Threads:1 Hosts:37 HostsPerProcess:37 DataSources:4456 RRDsProcessed:0
2019/08/14 15:40:00 - SYSTEM WARNING: Primary Admin account notifications disabled! Unable to send administrative Email.
2019/08/14 15:40:00 - POLLER: Poller[Main Poller] Maximum runtime of 298 seconds exceeded. Exiting.