DS data dosen't exist anymore but SPINE is still trying to process it

[Rno]

No it doesn't

Macan suggest it, It solve a few issue, but nothing related to my problem.

I think I cause the problem because I run a delete on 1000Graph at time, and spine was still running.
Somehow a few record where lock on the DB, and the delete process didn't go thru.

Something like that, and only a few table where deleted, like Graph and DS, but not the table in-between.

I start to 'decode' the action delete, still working on it!

[TheWitness]

It's actually a different script called repair_database.php.

You can also search for orphaned data sources.

[TheWitness]

Or looking for data sources with zero graphs.

[Rno]

Ok I find the script.
I run it with nothing first, to see !
then I run it with --tables:

Code: Select all

------------------------------------------------------------------------
NOTE: Repairing Tables for Local Database
NOTE: Repairing All 148 Cacti Database Tables
Repairing Table 'aggregate_graph_templates' Successful
Repairing Table 'aggregate_graph_templates_graph' Successful
Repairing Table 'aggregate_graph_templates_item' Successful
Repairing Table 'aggregate_graphs' Successful
Repairing Table 'aggregate_graphs_graph_item' Successful
Repairing Table 'aggregate_graphs_items' Successful
Repairing Table 'automation_devices' Successful
Repairing Table 'automation_graph_rule_items' Successful
Repairing Table 'automation_graph_rules' Successful
Repairing Table 'automation_ips' Successful
Repairing Table 'automation_match_rule_items' Successful
Repairing Table 'automation_networks' Successful
Repairing Table 'automation_processes' Successful
Repairing Table 'automation_snmp' Successful
Repairing Table 'automation_snmp_items' Successful
Repairing Table 'automation_templates' Successful
Repairing Table 'automation_tree_rule_items' Successful
Repairing Table 'automation_tree_rules' Successful
Repairing Table 'cdef' Successful
Repairing Table 'cdef_items' Successful
Repairing Table 'color_template_items' Successful
Repairing Table 'color_templates' Successful
Repairing Table 'colors' Successful
Repairing Table 'data_debug' Successful
Repairing Table 'data_input' Successful
Repairing Table 'data_input_data' Successful
Repairing Table 'data_input_fields' Successful
Repairing Table 'data_local' Successful
Repairing Table 'data_source_profiles' Successful
Repairing Table 'data_source_profiles_cf' Successful
Repairing Table 'data_source_profiles_rra' Successful
Repairing Table 'data_source_purge_action' Successful
Repairing Table 'data_source_purge_temp' Successful
Repairing Table 'data_source_stats_daily' Successful
Repairing Table 'data_source_stats_hourly' Successful
Repairing Table 'data_source_stats_hourly_cache' Successful
Repairing Table 'data_source_stats_hourly_last' Successful
Repairing Table 'data_source_stats_monthly' Successful
Repairing Table 'data_source_stats_weekly' Successful
Repairing Table 'data_source_stats_yearly' Successful
Repairing Table 'data_template' Successful
Repairing Table 'data_template_data' Successful
Repairing Table 'data_template_rrd' Successful
Repairing Table 'external_links' Successful
Repairing Table 'graph_local' Successful
Repairing Table 'graph_template_input' Successful
Repairing Table 'graph_template_input_defs' Successful
Repairing Table 'graph_templates' Successful
Repairing Table 'graph_templates_gprint' Successful
Repairing Table 'graph_templates_graph' Successful
Repairing Table 'graph_templates_item' Successful
Repairing Table 'graph_tree' Successful
Repairing Table 'graph_tree_items' Successful
Repairing Table 'host' Successful
Repairing Table 'host_graph' Successful
Repairing Table 'host_snmp_cache' Successful
Repairing Table 'host_snmp_query' Successful
Repairing Table 'host_template' Successful
Repairing Table 'host_template_graph' Successful
Repairing Table 'host_template_snmp_query' Successful
Repairing Table 'notification_queue' Successful
Repairing Table 'plugin_ciscotools_backup' Successful
Repairing Table 'plugin_ciscotools_image' Successful
Repairing Table 'plugin_ciscotools_mactrack' Successful
Repairing Table 'plugin_ciscotools_oui' Successful
Repairing Table 'plugin_ciscotools_upgrade' Successful
Repairing Table 'plugin_config' Successful
Repairing Table 'plugin_db_changes' Successful
Repairing Table 'plugin_extenddb_host_model' Successful
Repairing Table 'plugin_extenddb_host_serial_no' Successful
Repairing Table 'plugin_extenddb_model' Successful
Repairing Table 'plugin_hooks' Successful
Repairing Table 'plugin_linkdiscovery_hosts' Successful
Repairing Table 'plugin_linkdiscovery_intf' Successful
Repairing Table 'plugin_monitor_dashboards' Successful
Repairing Table 'plugin_monitor_notify_history' Successful
Repairing Table 'plugin_monitor_reboot_history' Successful
Repairing Table 'plugin_monitor_uptime' Successful
Repairing Table 'plugin_notification_lists' Successful
Repairing Table 'plugin_realms' Successful
Repairing Table 'plugin_thold_contacts' Successful
Repairing Table 'plugin_thold_daemon_data' Successful
Repairing Table 'plugin_thold_host' Successful
Repairing Table 'plugin_thold_host_failed' Successful
Repairing Table 'plugin_thold_host_template' Successful
Repairing Table 'plugin_thold_log' Successful
Repairing Table 'plugin_thold_template_contact' Successful
Repairing Table 'plugin_thold_threshold_contact' Successful
Repairing Table 'poller' Successful
Repairing Table 'poller_command' Successful
Repairing Table 'poller_data_template_field_mappings' Successful
Repairing Table 'poller_item' Successful
Repairing Table 'poller_output' Successful
Repairing Table 'poller_output_boost' Successful
Repairing Table 'poller_output_boost_local_data_ids' Successful
Repairing Table 'poller_output_boost_processes' Successful
Repairing Table 'poller_output_realtime' Successful
Repairing Table 'poller_reindex' Successful
Repairing Table 'poller_resource_cache' Successful
Repairing Table 'poller_time' Successful
Repairing Table 'processes' Successful
Repairing Table 'reports' Successful
Repairing Table 'reports_items' Successful
Repairing Table 'rrdcheck' Successful
Repairing Table 'sessions' Successful
Repairing Table 'settings' Successful
Repairing Table 'settings_tree' Successful
Repairing Table 'settings_user' Successful
Repairing Table 'settings_user_group' Successful
Repairing Table 'sites' Successful
Repairing Table 'snmp_query' Successful
Repairing Table 'snmp_query_graph' Successful
Repairing Table 'snmp_query_graph_rrd' Successful
Repairing Table 'snmp_query_graph_rrd_sv' Successful
Repairing Table 'snmp_query_graph_sv' Successful
Repairing Table 'snmpagent_cache' Successful
Repairing Table 'snmpagent_cache_notifications' Successful
Repairing Table 'snmpagent_cache_textual_conventions' Successful
Repairing Table 'snmpagent_managers' Successful
Repairing Table 'snmpagent_managers_notifications' Successful
Repairing Table 'snmpagent_mibs' Successful
Repairing Table 'snmpagent_notifications_log' Successful
Repairing Table 'syslog_programs' Successful
Repairing Table 'table_columns' Successful
Repairing Table 'table_indexes' Successful
Repairing Table 'thold_data' Successful
Repairing Table 'thold_template' Successful
Repairing Table 'user_auth' Successful
Repairing Table 'user_auth_cache' Successful
Repairing Table 'user_auth_group' Successful
Repairing Table 'user_auth_group_members' Successful
Repairing Table 'user_auth_group_perms' Successful
Repairing Table 'user_auth_group_realm' Successful
Repairing Table 'user_auth_perms' Successful
Repairing Table 'user_auth_realm' Successful
Repairing Table 'user_auth_row_cache' Successful
Repairing Table 'user_domains' Successful
Repairing Table 'user_domains_ldap' Successful
Repairing Table 'user_log' Successful
Repairing Table 'vdef' Successful
Repairing Table 'vdef_items' Successful
Repairing Table 'version' Successful
Repairing Table 'weathermap_auth' Successful
Repairing Table 'weathermap_config_cache' Successful
Repairing Table 'weathermap_data' Successful
Repairing Table 'weathermap_groups' Successful
Repairing Table 'weathermap_maps' Successful
Repairing Table 'weathermap_settings' Successful

Then with --force:

Code: Select all

NOTE: Searching for Invalid Cacti GPRINT Presets
NOTE: Found No Invalid Cacti GPRINT Presets
NOTE: Searching for Invalid Cacti CDEFs Presets
NOTE: Found No Invalid Cacti CDEFs
NOTE: Searching for Invalid Cacti Data Inputs
NOTE: Found No Invalid Cacti Data Inputs
NOTE: Searching for Graph Templates whose Graphs have invalid item counts
NOTE: Found No Graph Templates whose Graphs had incorrect item counts
NOTE: Searching for Invalid Cacti Data Input Fields
NOTE: Found No Invalid Cacti Data Input Fields
NOTE: Searching for Invalid Cacti Data Input Data Rows (Pass 1)
NOTE: Found and Fixed 10722 Invalid Data Input Data Rows in Data Templates
NOTE: Searching for Invalid Cacti Data Input Data Rows (Pass 2)
NOTE: Found No Invalid Cacti Data Input Data Rows (Pass 2)

But still the problem persist.

And I found something.
When I do a 'View Poller Cache' on the template ' - EnvMon - Temperature', I can see 36 entry, and the host match the one where I have a graph, and valid DS.

Then doing a 'Data Query Cache Items', I got 1670 entry, many with host with no graph and no DS.
So here is my (or at least one) of my problem, How can I rebuild this data query cache, and/or remove the wrong fields.