Urgent: problem with mysql -syslog plugin

General discussion about Plugins for Cacti

Moderators: Developers, Moderators

Post Reply
Giorgio
Posts: 21
Joined: Wed Jun 21, 2006 3:28 am

Urgent: problem with mysql -syslog plugin

Post by Giorgio »

Hy guys,

Today i have some troubles with my cacti. I'm in a workplacement and i finish it in few days.

The cpu usage is about 95% and is cause is mysql. I have this error :


060724 10:25:03 [ERROR] /usr/libexec/mysqld: Can't open file: 'syslog_incoming.MYI' (errno: 145)

I search in the net and i find this:

The following error may occur with a MySQL database table:

Can't open file: 'TableName.MYD'. (errno: 145)

This error usually means the 'TableName' table has become corrupt. From our experience, it appears the error commonly affects a table used for storing sessions and may occur the webs site/database has used up all allocated disk space. Additional disk space will normally need to be allocated.


In fact, the syslog plugin stop to work when i was a problem. this problem occur when my collegue configure syslog-ng which have bad redirections and so full the partition /var. Now everything is good but i have to stop msylog (i keep msyslog to cacti and in the futur maybe my collegue will put syslog-ng).

Now my cpu is good but i still to have every 5 minutes (maybe cati poller) the same error mike this:

060724 10:25:03 [ERROR] /usr/libexec/mysqld: Can't open file: 'syslog_incoming.MYI' (errno: 145)

I try to repair the databases with this command

mysqlcheck --auto-repair --databases cacti
cacti.cdef OK
cacti.cdef_items OK
cacti.colors OK
cacti.data_input OK
cacti.data_input_data OK
cacti.data_input_fields OK
cacti.data_local OK
cacti.data_template OK
cacti.data_template_data OK
cacti.data_template_data_rra OK
cacti.data_template_rrd OK
cacti.graph_local OK
cacti.graph_template_input OK
cacti.graph_template_input_defs OK
cacti.graph_templates OK
cacti.graph_templates_gprint OK
cacti.graph_templates_graph OK
cacti.graph_templates_item OK
cacti.graph_tree OK
cacti.graph_tree_items OK
cacti.host OK
cacti.host_graph OK
cacti.host_snmp_cache OK
cacti.host_snmp_query OK
cacti.host_template OK
cacti.host_template_graph OK
cacti.host_template_snmp_query OK
cacti.npc_comment OK
cacti.npc_config_params OK
cacti.npc_flapping_host OK
cacti.npc_flapping_service OK
cacti.npc_host OK
cacti.npc_host_check OK
cacti.npc_host_history OK
cacti.npc_hostgroup OK
cacti.npc_hostgroup_membership OK
cacti.npc_service OK
cacti.npc_service_check OK
cacti.npc_service_history OK
cacti.npc_servicegroup OK
cacti.npc_servicegroup_membership OK
cacti.plugin_update_info OK
cacti.poller OK
cacti.poller_command OK
cacti.poller_item OK
cacti.poller_output OK
cacti.poller_reindex OK
cacti.poller_time OK
cacti.reports OK
cacti.reports_data OK
cacti.rra OK
cacti.rra_cf OK
cacti.settings OK
cacti.settings_graphs OK
cacti.settings_tree OK
cacti.snmp_query OK
cacti.snmp_query_graph OK
cacti.snmp_query_graph_rrd OK
cacti.snmp_query_graph_rrd_sv OK
cacti.snmp_query_graph_sv OK
cacti.thold OK
cacti.thold_data OK
cacti.thold_template OK
cacti.tholdset OK
cacti.user_auth OK
cacti.user_auth_perms OK
cacti.user_auth_realm OK
cacti.user_log OK
cacti.version OK
cacti.weathermap_auth OK
cacti.weathermap_maps OK

Can you explain me what i have to do to put syslog plugin in work? And in the case of no solution how to delete complety this plugin.

thanks in advance

Giorgio
Top
User avatar
rony
Developer/Forum Admin
Posts: 6022
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:
Contact rony

Post by rony »

First, fix the free space issues on /var.

Second, if you can't repair the table in question, recreate it.

You will have to drop the table and use the create table statement from the SQL from the plugin to recreate it.

Moved to General Plugins
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]
Top
Giorgio
Posts: 21
Joined: Wed Jun 21, 2006 3:28 am

Post by Giorgio »

Ok thanks for your reply.

The free space issue on /var is fixed.

I didnt try to repair the table of thold. I only try this : mysqlcheck --auto-repair --databases cacti.

Can you explain me how to repair particularly this table please, if you have time of course. If not i will search in mysql books :cry:.

And in the case this table can't be repaired. What are the command to drop thold table.

Regards

Giorgio

NB: I know i have to learn mysql i see that's very important :(
Top
cigamit
Developer
Posts: 3369
Joined: Thu Apr 07, 2005 3:29 pm
Location: B/CS Texas
Contact:
Contact cigamit

Post by cigamit »

Actually, your repair command is specifying the cacti database instead of the syslog database.
Top
Giorgio
Posts: 21
Joined: Wed Jun 21, 2006 3:28 am

Post by Giorgio »

yeah i see it yesterday, i learn a little mysql command and now everything work fine.

Thanks cigamit.

NB: Did you now how to drop all the tables of a database in 1 time, or drop all the tables of a plugin (for example the tables of reports plugin in cacti database)?
Top
cigamit
Developer
Posts: 3369
Joined: Thu Apr 07, 2005 3:29 pm
Location: B/CS Texas
Contact:
Contact cigamit

Post by cigamit »

Giorgio wrote:NB: Did you now how to drop all the tables of a database in 1 time, or drop all the tables of a plugin (for example the tables of reports plugin in cacti database)?
There isn't really a command called DROP ALL TABLES, but you can specify multiple tables by their table name

http://dev.mysql.com/doc/refman/4.1/en/drop-table.html
Top
Giorgio
Posts: 21
Joined: Wed Jun 21, 2006 3:28 am

Post by Giorgio »

Ok it's that i do. Thanks for your help.

Giorgio
"A man who doesn't spend time with his family can never be a real man."
Top
nedo
Cacti User
Posts: 60
Joined: Thu Nov 16, 2006 8:58 pm

Post by nedo »

Hey Georgio how did you fixed the error i am having the same problem

i have tried this
mysqlcheck --auto-repair --databases syslog
mysqlcheck --auto-repair --databases cacti

but doesnt do anything

this is the error 060724 10:25:03 [ERROR] /usr/libexec/mysqld: Can't open file: 'syslog_incoming.MYI' (errno: 145)

it fills up really quickly how can i or how did u fix it
Top
nedo
Cacti User
Posts: 60
Joined: Thu Nov 16, 2006 8:58 pm

Post by nedo »

How did you get to stop mysqld.log to write to the file because its really filling up my disk space rally quickly

How can i stop this multiplication i keep have to delete the file anf keeps getting bigger and bigger

this is the error i get in
070711 14:18:06 [ERROR] /usr/libexec/mysqld: Can't open file: 'syslog_incoming.MYI' (errno: 145)

thanks
Top
moshiur
Posts: 9
Joined: Sun Sep 23, 2007 4:41 am

Error 1016 (HY000) at line 1: Can't open file: 'Syslog_incom

Post by moshiur »

I am getting here same error continously:
Error 1016 (HY000) at line 1: Can't open file: 'Syslog_incoming.MYI' (errno:145)



May be Giorgio solved this issue by DROP ALL TABLES (http://dev.mysql.com/doc/refman/4.1/en/drop-table.html). Can you please drop your command step by step ? or requesting to developers to give me some commands so that I can solve this issue.

My diagnosis result are in below:

[root@localhost ~]# crontab -l -u apache
*/5 * * * * php /var/www/html/poller.php > /dev/null 2>&1
*/1 * * * * php /var/www/html/plugins/monitor/fast_poller.php > /dev/null 2>&1


[root@localhost ~]# crontab -l
* * * * * /var/netflow/flow.pl > /dev/null 2>&1
1 1 * * * find /var/netflow/flows/completed/* -type d -mtime +5 -exec rm -fr {} \; > /dev/null 2>&1
0 1 * * * /var/www/backup.sh
0 * * * * /etc/webmin/bandwidth/rotate.pl


Log is is in below:

[root@localhost ~]# tail -n 100 -f /var/www/html/log/cacti.log
10/11/2007 07:56:21 PM - SYSTEM STATS: Time:77.8678 Method:cactid Processes:1 Threads:1 Hosts:62 HostsPerProcess:62 DataSources:319 RRDsProcessed:140
10/11/2007 07:56:24 PM - THOLD: Poller[0] Checking Thresholds
10/11/2007 08:00:20 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "insert into settings values ('syslog_last_incoming','')"
10/11/2007 08:00:21 PM - CACTID: Poller[0] Host[1] ERROR: Empty result [127.0.0.1]: '/usr/bin/php -q /var/www/html/plugins/haloe/syslog_counter.php'
10/11/2007 08:00:21 PM - CACTID: Poller[0] Host[1] DS[9] WARNING: Result from SCRIPT not valid. Partial Result: ...
10/11/2007 08:01:37 PM - SYSTEM STATS: Time:92.7737 Method:cactid Processes:1 Threads:1 Hosts:62 HostsPerProcess:62 DataSources:319 RRDsProcessed:140
10/11/2007 08:01:45 PM - THOLD: Poller[0] Checking Thresholds
10/11/2007 08:05:08 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "insert into settings values ('syslog_last_incoming','')"
10/11/2007 08:05:08 PM - CACTID: Poller[0] Host[1] ERROR: Empty result [127.0.0.1]: '/usr/bin/php -q /var/www/html/plugins/haloe/syslog_counter.php'
10/11/2007 08:05:08 PM - CACTID: Poller[0] Host[1] DS[9] WARNING: Result from SCRIPT not valid. Partial Result: ...
10/11/2007 08:05:15 PM - CMDPHP: Poller[0] Host[38] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/11/2007 08:06:26 PM - SYSTEM STATS: Time:82.5221 Method:cactid Processes:1 Threads:1 Hosts:62 HostsPerProcess:62 DataSources:319 RRDsProcessed:137
10/11/2007 08:06:29 PM - THOLD: Poller[0] Checking Thresholds
10/11/2007 08:09:13 PM - CMDPHP: Poller[0] Host[38] NOTICE: HOST EVENT: Host Returned from DOWN State:
10/11/2007 08:10:06 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "insert into settings values ('syslog_last_incoming','')"
10/11/2007 08:10:06 PM - CACTID: Poller[0] Host[1] ERROR: Empty result [127.0.0.1]: '/usr/bin/php -q /var/www/html/plugins/haloe/syslog_counter.php'
10/11/2007 08:10:06 PM - CACTID: Poller[0] Host[1] DS[9] WARNING: Result from SCRIPT not valid. Partial Result: ...
10/11/2007 08:11:19 PM - SYSTEM STATS: Time:76.4484 Method:cactid Processes:1 Threads:1 Hosts:62 HostsPerProcess:62 DataSources:319 RRDsProcessed:146
10/11/2007 08:11:24 PM - PCOMMAND: Poller[0] Host[38] WARNING: Recache Event Detected for Host
10/11/2007 08:11:25 PM - THOLD: Poller[0] Checking Thresholds
10/11/2007 08:11:26 PM - RECACHE STATS: RecacheTime:2.2679 HostsRecached:1
10/11/2007 08:12:20 PM - CMDPHP: Poller[0] Host[59] NOTICE: HOST EVENT: Host Returned from DOWN State:
10/11/2007 08:12:21 PM - CMDPHP: Poller[0] Host[60] NOTICE: HOST EVENT: Host Returned from DOWN State:
10/11/2007 08:15:07 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "insert into settings values ('syslog_last_incoming','')"
10/11/2007 08:15:08 PM - CACTID: Poller[0] Host[1] ERROR: Empty result [127.0.0.1]: '/usr/bin/php -q /var/www/html/plugins/haloe/syslog_counter.php'
10/11/2007 08:15:08 PM - CACTID: Poller[0] Host[1] DS[9] WARNING: Result from SCRIPT not valid. Partial Result: ...
10/11/2007 08:15:38 PM - CACTID: Poller[0] Host[25] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/11/2007 08:16:25 PM - SYSTEM STATS: Time:81.6959 Method:cactid Processes:1 Threads:1 Hosts:62 HostsPerProcess:62 DataSources:319 RRDsProcessed:137
10/11/2007 08:16:29 PM - THOLD: Poller[0] Checking Thresholds
10/11/2007 08:17:21 PM - CMDPHP: Poller[0] Host[59] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/11/2007 08:17:23 PM - CMDPHP: Poller[0] Host[60] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/11/2007 08:18:10 PM - CMDPHP: Poller[0] Host[25] NOTICE: HOST EVENT: Host Returned from DOWN State:
10/11/2007 08:18:13 PM - CMDPHP: Poller[0] Host[34] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/11/2007 08:20:04 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "truncate table poller_time"
10/11/2007 08:20:05 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 08:20:06 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 10/11/2007 09:03:10 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:11 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:12 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:13 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:14 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:15 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:16 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:17 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:18 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:19 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:20 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:21 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:22 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:23 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:24 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:25 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:26 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:27 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:28 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:29 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:30 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:31 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:32 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:33 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:34 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:35 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:36 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:37 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:38 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:39 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/11/2007 09:03:41 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/110/12/2007 01:00:32 AM - CACTID: Poller[0] ERROR: Problem with MySQL: 'Disk is full writing './cacti/poller_output.MYD' (Errcode: 28). Waiting for someone to free space... Retry in 60 secs'
10/12/2007 01:03:02 AM - CMDPHP: Poller[0] Host[19] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/12/2007 01:03:02 AM - CMDPHP: Poller[0] Host[19] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/12/2007 01:03:04 AM - CMDPHP: Poller[0] Host[19] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/12/2007 01:03:43 AM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "insert into settings values ('syslog_last_incoming','')"
10/12/2007 01:03:46 AM - CACTID: Poller[0] Host[1] ERROR: Empty result [127.0.0.1]: '/usr/bin/php -q /var/www/html/plugins/haloe/syslog_counter.php'
10/12/2007 01:03:46 AM - CACTID: Poller[0] Host[1] DS[9] WARNING: Result from SCRIPT not valid. Partial Result: ...
10/12/2007 01:05:07 AM - CMDPHP: Poller[0] Host[34] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/12/2007 01:05:13 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/12/2007 01:05:13 AM - POLLER: Poller[0] Maximum runtime of 292 seconds exceeded. Exiting.
10/12/2007 01:05:18 AM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "truncate table poller_time"
10/12/2007 01:05:18 AM - SYSTEM STATS: Time:308.2950 Method:cactid Processes:1 Threads:1 Hosts:62 HostsPerProcess:62 DataSources:319 RRDsProcessed:236
10/12/2007 01:05:20 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:23 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:24 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:26 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:27 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:28 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:35 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:42 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:38 AM - CMDPHP: Poller[0] Host[34] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/12/2007 01:05:43 AM - PCOMMAND: Poller[0] Host[13] WARNING: Recache Event Detected for Host
10/12/2007 01:05:43 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:45 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:46 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:47 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:48 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:49 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:50 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:50 AM - CACTID: Poller[0] WARNING: SS[0] The PHP Script Server did not respond in time and will therefore be restarted
10/12/2007 01:05:53 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id = 0"
10/12/2007 01:05:54 AM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_time where poller_id10/16/2007 03:18:07 PM - CMDPHP: Poller[0] Host[38] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/16/2007 03:18:13 PM - CMDPHP: Poller[0] Host[63] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP
10/16/2007 03:18:15 PM - CMDPHP: Poller[0] Host[64] ERROR: HOST EVENT: Host is DOWN Message: Host did not respond to SNMP

again

[root@localhost ~]# tail -n 100 -f /var/www/html/log/cacti.log
10/16/2007 03:19:07 PM - CMDPHP: Poller[0] Host[20] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:19:07 PM - CMDPHP: Poller[0] Host[22] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:19:08 PM - CMDPHP: Poller[0] Host[23] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:19:08 PM - CMDPHP: Poller[0] Host[28] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:19:08 PM - CMDPHP: Poller[0] Host[30] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:19:09 PM - CMDPHP: Poller[0] Host[31] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:19:09 PM - CMDPHP: Poller[0] Host[32] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:19:13 PM - CMDPHP: Poller[0] Host[46] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:19:15 PM - CMDPHP: Poller[0] Host[51] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:19:15 PM - CMDPHP: Poller[0] Host[52] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:19:15 PM - CMDPHP: Poller[0] Host[53] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:20:08 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "insert into s ettings values ('syslog_last_incoming','')"
10/16/2007 03:20:09 PM - CACTID: Poller[0] Host[1] ERROR: Empty result [127.0.0. 1]: '/usr/bin/php -q /var/www/html/plugins/haloe/syslog_counter.php'
10/16/2007 03:20:09 PM - CACTID: Poller[0] Host[1] DS[9] WARNING: Result from SC RIPT not valid. Partial Result: ...
10/16/2007 03:20:51 PM - SYSTEM STATS: Time:48.5903 Method:cactid Processes:1 Th reads:1 Hosts:62 HostsPerProcess:62 DataSources:317 RRDsProcessed:166
10/16/2007 03:21:13 PM - PCOMMAND: Poller[0] Host[13] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:14 PM - THOLD: Poller[0] Checking Thresholds
10/16/2007 03:21:19 PM - PCOMMAND: Poller[0] Host[14] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:21 PM - PCOMMAND: Poller[0] Host[15] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:23 PM - PCOMMAND: Poller[0] Host[18] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:25 PM - PCOMMAND: Poller[0] Host[22] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:27 PM - CMDPHP: Poller[0] Host[59] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:21:27 PM - PCOMMAND: Poller[0] Host[24] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:28 PM - CMDPHP: Poller[0] Host[60] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:21:29 PM - PCOMMAND: Poller[0] Host[25] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:30 PM - PCOMMAND: Poller[0] Host[28] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:32 PM - PCOMMAND: Poller[0] Host[2] WARNING: Recache Event Dete cted for Host
10/16/2007 03:21:34 PM - PCOMMAND: Poller[0] Host[30] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:35 PM - PCOMMAND: Poller[0] Host[35] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:37 PM - PCOMMAND: Poller[0] Host[37] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:39 PM - PCOMMAND: Poller[0] Host[40] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:41 PM - PCOMMAND: Poller[0] Host[44] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:43 PM - PCOMMAND: Poller[0] Host[47] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:45 PM - PCOMMAND: Poller[0] Host[51] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:46 PM - PCOMMAND: Poller[0] Host[53] WARNING: Recache Event Det ected for Host
10/16/2007 03:21:49 PM - PCOMMAND: Poller[0] Host[5] WARNING: Recache Event Dete cted for Host
10/16/2007 03:21:51 PM - PCOMMAND: Poller[0] Host[60] WARNING: Recache Event Det ected for Host
10/16/2007 03:22:13 PM - PCOMMAND: Poller[0] Host[61] WARNING: Recache Event Det ected for Host
10/16/2007 03:22:15 PM - PCOMMAND: Poller[0] Host[65] WARNING: Recache Event Det ected for Host
10/16/2007 03:22:17 PM - PCOMMAND: Poller[0] Host[6] WARNING: Recache Event Dete cted for Host
10/16/2007 03:22:19 PM - PCOMMAND: Poller[0] Host[8] WARNING: Recache Event Dete cted for Host
10/16/2007 03:22:21 PM - RECACHE STATS: RecacheTime:68.5720 HostsRecached:23
10/16/2007 03:25:14 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "insert into s ettings values ('syslog_last_incoming','')"
10/16/2007 03:25:14 PM - CACTID: Poller[0] Host[1] ERROR: Empty result [127.0.0. 1]: '/usr/bin/php -q /var/www/html/plugins/haloe/syslog_counter.php'
10/16/2007 03:25:14 PM - CACTID: Poller[0] Host[1] DS[9] WARNING: Result from SC RIPT not valid. Partial Result: ...
10/16/2007 03:25:53 PM - SYSTEM STATS: Time:48.5896 Method:cactid Processes:1 Th reads:1 Hosts:62 HostsPerProcess:62 DataSources:319 RRDsProcessed:170
10/16/2007 03:25:59 PM - PCOMMAND: Poller[0] Host[34] WARNING: Recache Event Det ected for Host
10/16/2007 03:25:59 PM - THOLD: Poller[0] Checking Thresholds
10/16/2007 03:26:04 PM - RECACHE STATS: RecacheTime:5.0367 HostsRecached:1
10/16/2007 03:26:09 PM - CMDPHP: Poller[0] Host[34] NOTICE: HOST EVENT: Host Ret urned from DOWN State:
10/16/2007 03:30:12 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "insert into s ettings values ('syslog_last_incoming','')"
10/16/2007 03:30:13 PM - CACTID: Poller[0] Host[1] ERROR: Empty result [127.0.0. 1]: '/usr/bin/php -q /var/www/html/plugins/haloe/syslog_counter.php'
10/16/2007 03:30:13 PM - CACTID: Poller[0] Host[1] DS[9] WARNING: Result from SC RIPT not valid. Partial Result: ...
10/16/2007 03:30:53 PM - SYSTEM STATS: Time:49.3996 Method:cactid Processes:1 Th reads:1 Hosts:62 HostsPerProcess:62 DataSources:319 RRDsProcessed:170
10/16/2007 03:31:04 PM - THOLD: Poller[0] Checking Thresholds
10/16/2007 03:35:04 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "truncate tabl e poller_time"
10/16/2007 03:35:05 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 03:35:06 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 03:35:07 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 03:35:08 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 03:35:09 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 03:35:11 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 03:35:12 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 03:35:13 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 03:35:14 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 03:35:14 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "insert into s ettings values ('syslog_last_incoming','')"
10/16/2007 03:35:14 PM - CACTID: Poller[0] Host[1] ERROR: Empty result [127.0.0. 1]: '/usr/bin/php -q /var/www/html/plugins/haloe/syslog_counter.php'
10/16/2007 03:35:14 PM - CACTID: Poller[0] Host[1] DS[9] WARNING: Result from SC RIPT not valid. Partial Result: ...
10/16/2007 03:35:15 PM - CMDPHP: Poller[0] ERROR: S10/16/2007 04:00:52 PM - CMDP HP: Poller[0] ERROR: SQL Assoc Failed "select poller_id,end_time from poller_tim e where poller_id = 0"
10/16/2007 04:00:53 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:00:54 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:00:55 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:00:56 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:00:57 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:00:58 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:00:59 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:00 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:01 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:02 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:03 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:05 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:06 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:07 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:08 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:09 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:10 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:11 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:12 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:13 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:14 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:15 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:16 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:17 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:18 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:19 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:20 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:21 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:22 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/16/2007 04:01:23 PM - CMDPHP: Poller[0] ERROR: SQL Assoc Failed "select polle r_id,end_time from poller_time where poller_id = 0"
10/1


Database Repair

[root@localhost ~]# mysqlcheck --auto-repair --databases cacti
cacti.cdef OK
cacti.cdef_items OK
cacti.colors OK
cacti.data_input OK
cacti.data_input_data
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.data_input_fields OK
cacti.data_local
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.data_template OK
cacti.data_template_data
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.data_template_data_rra
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.data_template_rrd
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.graph_local
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.graph_template_input OK
cacti.graph_template_input_defs OK
cacti.graph_templates OK
cacti.graph_templates_gprint OK
cacti.graph_templates_graph
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.graph_templates_item
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.graph_tree OK
cacti.graph_tree_items OK
cacti.host
warning : 3 clients are using or haven't closed the table properly
status : OK
cacti.host_graph
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.host_snmp_cache
warning : 3 clients are using or haven't closed the table properly
status : OK
cacti.host_snmp_query
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.host_template OK
cacti.host_template_graph OK
cacti.host_template_snmp_query OK
cacti.mac_track_device_types OK
cacti.mac_track_devices OK
cacti.mac_track_ips OK
cacti.mac_track_ports OK
cacti.mac_track_processes OK
cacti.mac_track_scan_dates OK
cacti.mac_track_scanning_functions OK
cacti.mac_track_sites OK
cacti.mac_track_temp_ports OK
cacti.plugin_discover_hosts OK
cacti.plugin_discover_os OK
cacti.plugin_flowview_dnscache
note : The storage engine for the table doesn't support check
cacti.plugin_update_info OK
cacti.poller OK
cacti.poller_command
warning : 3 clients are using or haven't closed the table properly
status : OK
cacti.poller_item
warning : 3 clients are using or haven't closed the table properly
status : OK
cacti.poller_output OK
cacti.poller_reindex
warning : 3 clients are using or haven't closed the table properly
status : OK
cacti.poller_time OK
cacti.rra OK
cacti.rra_cf OK
cacti.settings
warning : 3 clients are using or haven't closed the table properly
status : OK
cacti.settings_graphs OK
cacti.settings_tree OK
cacti.snmp_query OK
cacti.snmp_query_graph OK
cacti.snmp_query_graph_rrd OK
cacti.snmp_query_graph_rrd_sv OK
cacti.snmp_query_graph_sv OK
cacti.thold OK
cacti.thold_data
warning : 3 clients are using or haven't closed the table properly
status : OK
cacti.thold_template OK
cacti.tholdset
warning : 2 clients are using or haven't closed the table properly
status : OK
cacti.user_auth
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.user_auth_perms OK
cacti.user_auth_realm
warning : 1 client is using or hasn't closed the table properly
status : OK
cacti.user_log OK
cacti.version OK
cacti.weathermap_auth OK
cacti.weathermap_maps OK


AGAIN SAME

[root@localhost ~]# mysqlcheck --auto-repair --databases cacti
cacti.cdef OK
cacti.cdef_items OK
cacti.colors OK
cacti.data_input OK
cacti.data_input_data OK
cacti.data_input_fields OK
cacti.data_local OK
cacti.data_template OK
cacti.data_template_data OK
cacti.data_template_data_rra OK
cacti.data_template_rrd OK
cacti.graph_local OK
cacti.graph_template_input OK
cacti.graph_template_input_defs OK
cacti.graph_templates OK
cacti.graph_templates_gprint OK
cacti.graph_templates_graph OK
cacti.graph_templates_item OK
cacti.graph_tree OK
cacti.graph_tree_items OK
cacti.host OK
cacti.host_graph OK
cacti.host_snmp_cache OK
cacti.host_snmp_query OK
cacti.host_template OK
cacti.host_template_graph OK
cacti.host_template_snmp_query OK
cacti.mac_track_device_types OK
cacti.mac_track_devices OK
cacti.mac_track_ips OK
cacti.mac_track_ports OK
cacti.mac_track_processes OK
cacti.mac_track_scan_dates OK
cacti.mac_track_scanning_functions OK
cacti.mac_track_sites OK
cacti.mac_track_temp_ports OK
cacti.plugin_discover_hosts OK
cacti.plugin_discover_os OK
cacti.plugin_flowview_dnscache
note : The storage engine for the table doesn't support check
cacti.plugin_update_info OK
cacti.poller OK
cacti.poller_command OK
cacti.poller_item OK
cacti.poller_output OK
cacti.poller_reindex OK
cacti.poller_time
error : Can't find file: 'poller_time.MYI' (errno: 2)
cacti.rra OK
cacti.rra_cf OK
cacti.settings OK
cacti.settings_graphs OK
cacti.settings_tree OK
cacti.snmp_query OK
cacti.snmp_query_graph OK
cacti.snmp_query_graph_rrd OK
cacti.snmp_query_graph_rrd_sv OK
cacti.snmp_query_graph_sv OK
cacti.thold OK
cacti.thold_data OK
cacti.thold_template OK
cacti.tholdset OK
cacti.user_auth OK
cacti.user_auth_perms OK
cacti.user_auth_realm OK
cacti.user_log OK
cacti.version OK
cacti.weathermap_auth OK
cacti.weathermap_maps OK

Repairing tables
cacti.poller_time
error : Can't find file: 'poller_time.MYI' (errno: 2)
[root@localhost ~]#
Top
User avatar
TheWitness
Developer
Posts: 17047
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

You can do the following for all tables:

Code: Select all

#mysql cacti
> REPAIR TABLE xxx USE_FRM
> quit;
I have a nice script for this as well, attached. You will have to make some slight modifications for your application.

TheWitness
Attachments
database_repair.zip
(1.56 KiB) Downloaded 381 times
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
cigamit
Developer
Posts: 3369
Joined: Thu Apr 07, 2005 3:29 pm
Location: B/CS Texas
Contact:
Contact cigamit

Post by cigamit »

Run a repair on your syslog database (not your cacti database) in particular, your syslog_incoming table is corrupted, just as the error states.
Top
Post Reply

Return to “Plugin General”

Who is online

Users browsing this forum: No registered users and 5 guests