Hundreds of poller_output errors with DB

[curioshuman]

Of late I have been seeing a lot of the following errors:

Jul 16 16:55:31 MRHMONDR-DNSTL-01 Cacti[22416]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (1552, 'traffic_in', '2020-07-16 16:55:30', '4191782758')'
Jul 16 16:55:31 MRHMONDR-DNSTL-01 Cacti[22416]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (1552, 'traffic_out', '2020-07-16 16:55:30', '3486306232')'
Jul 16 16:55:31 MRHMONDR-DNSTL-01 Cacti[22416]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (1553, 'traffic_in', '2020-07-16 16:55:30', '2617349945')'

I saw some other topic with similar errors, where they were talking about parallel, conlflicting crontab entries. But there aren't such crontab entries in the servers. What else could be causing this issue? This causing the logs to full up fast to the tune of gigabytes and causing issues on the server.

[TheWitness]

A 1062 error generally means two crontab entries are launching the poller. There are other cases, but you have not provided nearly enough information on your system.

[curioshuman]

What other information should I provide? Please let me know

A 1062 error generally means two crontab entries are launching the poller. There are other cases, but you have not provided nearly enough information on your system.

[TheWitness]

Well, if you don't have multiple processes running on the host launched from separate sources, and ps should show this, then you should run show process list on the database during poller operation and look for connections from other servers.

[curioshuman]

I currently see the errors in the logs and here is the list of processes that cacti user is running:


/usr/bin/php -q /usr/share/cacti/cmd.php 0 149
/usr/bin/php -q /usr/share/cacti/script_server.php cmd
[sh] <defunct>
/usr/bin/php -q /usr/share/cacti/cmd.php 0 149
/usr/bin/php -q /usr/share/cacti/cmd.php 0 149
[php] <defunct>
[php] <defunct>
/usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t -f root
[sh] <defunct>
/usr/bin/php -q /usr/share/cacti/cmd.php 0 149
[php] <defunct>
/usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t -f root
/usr/bin/php -q /usr/share/cacti/cmd.php 0 149
/usr/bin/php -q /usr/share/cacti/script_server.php cmd
/bin/sh -c /usr/bin/php /usr/share/cacti/poller.php > /dev/null 2>&1
/usr/bin/php /usr/share/cacti/poller.php
/usr/bin/php -q /usr/share/cacti/cmd.php 0 149
/usr/bin/rrdtool -
/usr/bin/php -q /usr/share/cacti/script_server.php cmd

Here is the errors in logs that I see repeating:
----------------------------------------------------------
Jul 21 14:02:17 MRHMONDR-DNSTL-01 Cacti[9873]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (369, 'sysMultiHostCpuIdle', '2020-07-21 14:02:13', '862684942')'
Jul 21 14:02:17 MRHMONDR-DNSTL-01 Cacti[9872]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (369, 'sysMultiHostCpuUser', '2020-07-21 14:02:13', '393178123')'
Jul 21 14:02:17 MRHMONDR-DNSTL-01 Cacti[9872]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (369, 'sysMultiHostCpuIrq', '2020-07-21 14:02:13', '0')'
Jul 21 14:02:18 MRHMONDR-DNSTL-01 Cacti[9872]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (369, 'sysMultiHostCpuNice', '2020-07-21 14:02:13', '127028')'
Jul 21 14:02:18 MRHMONDR-DNSTL-01 Cacti[9872]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (369, 'sysMultiHostCpuSyst', '2020-07-21 14:02:13', '52563371')'
Jul 21 14:02:18 MRHMONDR-DNSTL-01 Cacti[9873]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (369, 'sysMultiHostCpuSoft', '2020-07-21 14:02:13', '2496752')'
Jul 21 14:02:18 MRHMONDR-DNSTL-01 Cacti[9873]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (369, 'sysMultiHostCpuIowa', '2020-07-21 14:02:13', '185412')'
Jul 21 14:02:18 MRHMONDR-DNSTL-01 Cacti[9873]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (370, 'sysMultiHostCpuIdle', '2020-07-21 14:02:13', '1182101406')'
Jul 21 14:02:18 MRHMONDR-DNSTL-01 Cacti[9872]: CMDPHP: ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (370, 'sysMultiHostCpuUser', '2020-07-21 14:02:13', '82363495')'

Well, if you don't have multiple processes running on the host launched from separate sources, and ps should show this, then you should run show process list on the database during poller operation and look for connections from other servers.

[TheWitness]

Use spine. The default poller is for demos and not for production.

[curioshuman]

But I have other instances where this is running without issues, what else could be a problem here ?

Use spine. The default poller is for demos and not for production.