DS data dosen't exist anymore but SPINE is still trying to process it

Post support questions that directly relate to Linux/Unix operating systems.

Moderators: Developers, Moderators

Rno
Cacti Pro User
Posts: 704
Joined: Wed Dec 07, 2011 9:19 am

Re: DS data dosen't exist anymore but SPINE is still trying to process it

Post by Rno »

No it doesn't

Macan suggest it, It solve a few issue, but nothing related to my problem.

I think I cause the problem because I run a delete on 1000Graph at time, and spine was still running.
Somehow a few record where lock on the DB, and the delete process didn't go thru.

Something like that, and only a few table where deleted, like Graph and DS, but not the table in-between.

I start to 'decode' the action delete, still working on it!
Test
Almalinux
php 8.2.14
mariadb 10.6.16
Cacti 1.2.27
Spine 1.2.27
RRD 1.7.2
thold 1.8
monitor 2.5
syslog 3.2
flowview: 3.3
weathermap 1.0 Beta
User avatar
TheWitness
Developer
Posts: 17047
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: DS data dosen't exist anymore but SPINE is still trying to process it

Post by TheWitness »

It's actually a different script called repair_database.php.

You can also search for orphaned data sources.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
User avatar
TheWitness
Developer
Posts: 17047
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: DS data dosen't exist anymore but SPINE is still trying to process it

Post by TheWitness »

Or looking for data sources with zero graphs.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Rno
Cacti Pro User
Posts: 704
Joined: Wed Dec 07, 2011 9:19 am

Re: DS data dosen't exist anymore but SPINE is still trying to process it

Post by Rno »

Ok I find the script.
I run it with nothing first, to see !
then I run it with --tables:

Code: Select all

------------------------------------------------------------------------
NOTE: Repairing Tables for Local Database
NOTE: Repairing All 148 Cacti Database Tables
Repairing Table 'aggregate_graph_templates' Successful
Repairing Table 'aggregate_graph_templates_graph' Successful
Repairing Table 'aggregate_graph_templates_item' Successful
Repairing Table 'aggregate_graphs' Successful
Repairing Table 'aggregate_graphs_graph_item' Successful
Repairing Table 'aggregate_graphs_items' Successful
Repairing Table 'automation_devices' Successful
Repairing Table 'automation_graph_rule_items' Successful
Repairing Table 'automation_graph_rules' Successful
Repairing Table 'automation_ips' Successful
Repairing Table 'automation_match_rule_items' Successful
Repairing Table 'automation_networks' Successful
Repairing Table 'automation_processes' Successful
Repairing Table 'automation_snmp' Successful
Repairing Table 'automation_snmp_items' Successful
Repairing Table 'automation_templates' Successful
Repairing Table 'automation_tree_rule_items' Successful
Repairing Table 'automation_tree_rules' Successful
Repairing Table 'cdef' Successful
Repairing Table 'cdef_items' Successful
Repairing Table 'color_template_items' Successful
Repairing Table 'color_templates' Successful
Repairing Table 'colors' Successful
Repairing Table 'data_debug' Successful
Repairing Table 'data_input' Successful
Repairing Table 'data_input_data' Successful
Repairing Table 'data_input_fields' Successful
Repairing Table 'data_local' Successful
Repairing Table 'data_source_profiles' Successful
Repairing Table 'data_source_profiles_cf' Successful
Repairing Table 'data_source_profiles_rra' Successful
Repairing Table 'data_source_purge_action' Successful
Repairing Table 'data_source_purge_temp' Successful
Repairing Table 'data_source_stats_daily' Successful
Repairing Table 'data_source_stats_hourly' Successful
Repairing Table 'data_source_stats_hourly_cache' Successful
Repairing Table 'data_source_stats_hourly_last' Successful
Repairing Table 'data_source_stats_monthly' Successful
Repairing Table 'data_source_stats_weekly' Successful
Repairing Table 'data_source_stats_yearly' Successful
Repairing Table 'data_template' Successful
Repairing Table 'data_template_data' Successful
Repairing Table 'data_template_rrd' Successful
Repairing Table 'external_links' Successful
Repairing Table 'graph_local' Successful
Repairing Table 'graph_template_input' Successful
Repairing Table 'graph_template_input_defs' Successful
Repairing Table 'graph_templates' Successful
Repairing Table 'graph_templates_gprint' Successful
Repairing Table 'graph_templates_graph' Successful
Repairing Table 'graph_templates_item' Successful
Repairing Table 'graph_tree' Successful
Repairing Table 'graph_tree_items' Successful
Repairing Table 'host' Successful
Repairing Table 'host_graph' Successful
Repairing Table 'host_snmp_cache' Successful
Repairing Table 'host_snmp_query' Successful
Repairing Table 'host_template' Successful
Repairing Table 'host_template_graph' Successful
Repairing Table 'host_template_snmp_query' Successful
Repairing Table 'notification_queue' Successful
Repairing Table 'plugin_ciscotools_backup' Successful
Repairing Table 'plugin_ciscotools_image' Successful
Repairing Table 'plugin_ciscotools_mactrack' Successful
Repairing Table 'plugin_ciscotools_oui' Successful
Repairing Table 'plugin_ciscotools_upgrade' Successful
Repairing Table 'plugin_config' Successful
Repairing Table 'plugin_db_changes' Successful
Repairing Table 'plugin_extenddb_host_model' Successful
Repairing Table 'plugin_extenddb_host_serial_no' Successful
Repairing Table 'plugin_extenddb_model' Successful
Repairing Table 'plugin_hooks' Successful
Repairing Table 'plugin_linkdiscovery_hosts' Successful
Repairing Table 'plugin_linkdiscovery_intf' Successful
Repairing Table 'plugin_monitor_dashboards' Successful
Repairing Table 'plugin_monitor_notify_history' Successful
Repairing Table 'plugin_monitor_reboot_history' Successful
Repairing Table 'plugin_monitor_uptime' Successful
Repairing Table 'plugin_notification_lists' Successful
Repairing Table 'plugin_realms' Successful
Repairing Table 'plugin_thold_contacts' Successful
Repairing Table 'plugin_thold_daemon_data' Successful
Repairing Table 'plugin_thold_host' Successful
Repairing Table 'plugin_thold_host_failed' Successful
Repairing Table 'plugin_thold_host_template' Successful
Repairing Table 'plugin_thold_log' Successful
Repairing Table 'plugin_thold_template_contact' Successful
Repairing Table 'plugin_thold_threshold_contact' Successful
Repairing Table 'poller' Successful
Repairing Table 'poller_command' Successful
Repairing Table 'poller_data_template_field_mappings' Successful
Repairing Table 'poller_item' Successful
Repairing Table 'poller_output' Successful
Repairing Table 'poller_output_boost' Successful
Repairing Table 'poller_output_boost_local_data_ids' Successful
Repairing Table 'poller_output_boost_processes' Successful
Repairing Table 'poller_output_realtime' Successful
Repairing Table 'poller_reindex' Successful
Repairing Table 'poller_resource_cache' Successful
Repairing Table 'poller_time' Successful
Repairing Table 'processes' Successful
Repairing Table 'reports' Successful
Repairing Table 'reports_items' Successful
Repairing Table 'rrdcheck' Successful
Repairing Table 'sessions' Successful
Repairing Table 'settings' Successful
Repairing Table 'settings_tree' Successful
Repairing Table 'settings_user' Successful
Repairing Table 'settings_user_group' Successful
Repairing Table 'sites' Successful
Repairing Table 'snmp_query' Successful
Repairing Table 'snmp_query_graph' Successful
Repairing Table 'snmp_query_graph_rrd' Successful
Repairing Table 'snmp_query_graph_rrd_sv' Successful
Repairing Table 'snmp_query_graph_sv' Successful
Repairing Table 'snmpagent_cache' Successful
Repairing Table 'snmpagent_cache_notifications' Successful
Repairing Table 'snmpagent_cache_textual_conventions' Successful
Repairing Table 'snmpagent_managers' Successful
Repairing Table 'snmpagent_managers_notifications' Successful
Repairing Table 'snmpagent_mibs' Successful
Repairing Table 'snmpagent_notifications_log' Successful
Repairing Table 'syslog_programs' Successful
Repairing Table 'table_columns' Successful
Repairing Table 'table_indexes' Successful
Repairing Table 'thold_data' Successful
Repairing Table 'thold_template' Successful
Repairing Table 'user_auth' Successful
Repairing Table 'user_auth_cache' Successful
Repairing Table 'user_auth_group' Successful
Repairing Table 'user_auth_group_members' Successful
Repairing Table 'user_auth_group_perms' Successful
Repairing Table 'user_auth_group_realm' Successful
Repairing Table 'user_auth_perms' Successful
Repairing Table 'user_auth_realm' Successful
Repairing Table 'user_auth_row_cache' Successful
Repairing Table 'user_domains' Successful
Repairing Table 'user_domains_ldap' Successful
Repairing Table 'user_log' Successful
Repairing Table 'vdef' Successful
Repairing Table 'vdef_items' Successful
Repairing Table 'version' Successful
Repairing Table 'weathermap_auth' Successful
Repairing Table 'weathermap_config_cache' Successful
Repairing Table 'weathermap_data' Successful
Repairing Table 'weathermap_groups' Successful
Repairing Table 'weathermap_maps' Successful
Repairing Table 'weathermap_settings' Successful
Then with --force:

Code: Select all

NOTE: Searching for Invalid Cacti GPRINT Presets
NOTE: Found No Invalid Cacti GPRINT Presets
NOTE: Searching for Invalid Cacti CDEFs Presets
NOTE: Found No Invalid Cacti CDEFs
NOTE: Searching for Invalid Cacti Data Inputs
NOTE: Found No Invalid Cacti Data Inputs
NOTE: Searching for Graph Templates whose Graphs have invalid item counts
NOTE: Found No Graph Templates whose Graphs had incorrect item counts
NOTE: Searching for Invalid Cacti Data Input Fields
NOTE: Found No Invalid Cacti Data Input Fields
NOTE: Searching for Invalid Cacti Data Input Data Rows (Pass 1)
NOTE: Found and Fixed 10722 Invalid Data Input Data Rows in Data Templates
NOTE: Searching for Invalid Cacti Data Input Data Rows (Pass 2)
NOTE: Found No Invalid Cacti Data Input Data Rows (Pass 2)

But still the problem persist.

And I found something.
When I do a 'View Poller Cache' on the template ' - EnvMon - Temperature', I can see 36 entry, and the host match the one where I have a graph, and valid DS.

Then doing a 'Data Query Cache Items', I got 1670 entry, many with host with no graph and no DS.
So here is my (or at least one) of my problem, How can I rebuild this data query cache, and/or remove the wrong fields.
Test
Almalinux
php 8.2.14
mariadb 10.6.16
Cacti 1.2.27
Spine 1.2.27
RRD 1.7.2
thold 1.8
monitor 2.5
syslog 3.2
flowview: 3.3
weathermap 1.0 Beta
Post Reply

Who is online

Users browsing this forum: No registered users and 3 guests