MYSQL error: Duplicate key when polling

joshh · Post by **joshh** » Wed Jul 12, 2006 12:57 pm

I am seeing a lot of errors:

...

07/12/2006 10:45:02 AM - CACTID: Poller[0] ERROR: Problem with MySQL: 'Duplicate entry '3-mem_buffers-2006-07-12 10:45:01' for key 1'
07/12/2006 10:45:02 AM - CACTID: Poller[0] ERROR: Problem with MySQL: 'Duplicate entry '17-traffic_in-2006-07-12 10:45:01' for key 1'
07/12/2006 10:45:03 AM - CACTID: Poller[0] ERROR: Problem with MySQL: 'Duplicate entry '28-traffic_in-2006-07-12 10:45:01' for key 1'

...

more that 100. I don't know what table the error is coming from.
Anyone have any thoughts on this?

Thanks,
Josh

Post by **rony** » Wed Jul 12, 2006 2:28 pm

Wait for a polling cycle to complete.

When the poller is not running, run the following query on you Cacti database:

Code: Select all

truncate poller_output;

It seems a poller crashed in the past leaving items in the poller_output table. Under normal operation, when the poller is not running, this table will have not items in it.

joshh · Post by **joshh** » Wed Jul 12, 2006 2:59 pm

looking at this table there are no left over entries.
I did just notice that my poller frequency seems to be too short. polling is taking longer than 5 minutes. The previous poller is not done by the time the next one is launched.

I am already using CACTID so I will have to look into why this is taking so long. I did increase snmp timeouts as well as ping timeout so this may be a factor.

Thanks,
Josh

Post by **rony** » Wed Jul 12, 2006 3:03 pm

How many devices and data source do you have?

How much memory does the server have? You might help you polling time buy just adding more memory to increase the OS disk cache.

joshh · Post by **joshh** » Wed Jul 12, 2006 4:22 pm

the server has 3GB of ram. slightly more that 1GB is currently free.

I am polling more than 160 devices and it looks like 1825 data sources.
This will be growing by at least a factor of 2-3 once everything is in there. there will be 400-500 devices.

thanks for the help!
Josh

joshh · Post by **joshh** » Wed Jul 12, 2006 4:51 pm

I pulled the DS number (1825) from the poller_item table.
Not sure if this is correct.

Post by **rony** » Wed Jul 12, 2006 6:50 pm

Look at the SYSTEM STATS line in the Cacti log and it will tell me all I need to know.

joshh · Post by **joshh** » Wed Jul 12, 2006 6:51 pm

here is what I am seeing now. pretty much the same:

Code: Select all

07/12/2006 04:45:17 PM - CACTID: Poller[0] ERROR: Problem with MySQL: 'Duplicate entry '1572-traffic_in-2006-07-12 16:45:09' for key 1'
07/12/2006 04:49:54 PM - POLLER: Poller[0] Maximum runtime of 292 seconds exceeded. Exiting.
07/12/2006 04:49:54 PM - SYSTEM STATS: Time:292.4031 Method:cactid Processes:10 Threads:12 Hosts:126 HostsPerProcess:13 DataSources:1533 RRDsProcessed:1358
07/12/2006 04:49:54 PM - POLLER: Poller[0] Maximum runtime of 292 seconds exceeded. Exiting.
07/12/2006 04:49:54 PM - SYSTEM STATS: Time:292.4074 Method:cactid Processes:10 Threads:12 Hosts:126 HostsPerProcess:13 DataSources:1533 RRDsProcessed:1304
07/12/2006 04:49:54 PM - PCOMMAND: Poller[0] Host[11] WARNING: Recache Event Detected for Host
07/12/2006 04:49:54 PM - PCOMMAND: Poller[0] Host[11] WARNING: Recache Event Detected for Host
07/12/2006 04:49:54 PM - THOLD: Poller[0] Checking Thresholds
07/12/2006 04:49:54 PM - THOLD: Poller[0] Checking Thresholds
07/12/2006 04:49:55 PM - PCOMMAND: Poller[0] Host[15] WARNING: Recache Event Detected for Host
07/12/2006 04:49:55 PM - PCOMMAND: Poller[0] Host[15] WARNING: Recache Event Detected for Host
07/12/2006 04:49:56 PM - PCOMMAND: Poller[0] Host[17] WARNING: Recache Event Detected for Host
07/12/2006 04:49:56 PM - PCOMMAND: Poller[0] Host[17] WARNING: Recache Event Detected for Host
07/12/2006 04:49:57 PM - PCOMMAND: Poller[0] Host[20] WARNING: Recache Event Detected for Host
07/12/2006 04:49:57 PM - PCOMMAND: Poller[0] Host[20] WARNING: Recache Event Detected for Host
07/12/2006 04:50:02 PM - CACTID: Poller[0] ERROR: Problem with MySQL: 'Duplicate entry '3-mem_buffers-2006-07-12 16:50:01' for key 1'
07/12/2006 04:50:02 PM - CACTID: Poller[0] ERROR: Problem with MySQL: 'Duplicate entry '17-traffic_in-2006-07-12 16:50:01' for key 1'
07/12/2006 04:50:03 PM - CACTID: Poller[0] ERROR: Problem with MySQL: 'Duplicate entry '28-traffic_in-2006-07-12 16:50:01' for key 1'
07/12/2006 04:50:03 PM - CACTID: Poller[0] ERROR: Problem with MySQL: 'Duplicate entry '149-traffic_in-2006-07-12 16:50:02' for key 1'

joshh · Post by **joshh** » Thu Jul 13, 2006 5:11 pm

ok got it:

Code: Select all

07/13/2006 02:55:15 PM - SYSTEM STATS: Time:13.8235 Method:cactid Processes:10 Threads:12 Hosts:126 HostsPerProcess:13 DataSources:1533 RRDsProcessed:1280
07/13/2006 02:55:15 PM - SYSTEM STATS: Time:13.8333 Method:cactid Processes:10 Threads:12 Hosts:126 HostsPerProcess:13 DataSources:1533 RRDsProcessed:1197

Post by **rony** » Thu Jul 13, 2006 5:38 pm

What OS? Distro?

I would suggest you take the poller offline and run a check/repair on the database.

joshh · Post by **joshh** » Thu Jul 13, 2006 5:46 pm

bummer.
running Red Hat 4

Post by **TheWitness** » Thu Jul 13, 2006 5:53 pm

Can you please update to the SVN version of Cactid? BRANCH_0_8_6. This problem is caused by a data query.

TheWitness

joshh · Post by **joshh** » Thu Jul 13, 2006 6:32 pm

there is no configure script in cactid under that branch.

am I missing something?

joshh · Post by **joshh** » Thu Jul 13, 2006 6:40 pm

never mind. got it figured out.

joshh · Post by **joshh** » Thu Jul 13, 2006 6:52 pm

got the new cactid built but am still seeing this problem.

do I need to update my cacti installation as well?

Cacti

MYSQL error: Duplicate key when polling

MYSQL error: Duplicate key when polling

ahh

Who is online