A few graphs/rrds not updating on a single host

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

Post Reply
jkrejci
Posts: 11
Joined: Mon Sep 27, 2010 9:44 am

A few graphs/rrds not updating on a single host

Post by jkrejci »

Cacti version 0.8.7g (linux)
Not aware of any changes made at the time this started, all but one interfaces on a single switch have no graphing for traffic, all other graphs on the device are fine
  • tried clearing poller cache
  • rrd files look good (perms/ownership), last date modified for traffic was about a week and a half ago for the non-updating rrds
  • "rrdtool info $example_traffic_RRD" results with min/max all look good and within boundaries. step=300 and heartbeat=600
  • Debug on graph management shows DEF to be identical between working and non-working graphs (except for the RRD file path obviously)
  • cacti log "debug" - not showing "traffic queries" for all except the one interface. all other interface stats are good (unicast packets, uptime, etc)
  • data source lists yes in the active column for the non-working graphs
Its as if cacti is just ignoring these data sources for some reason. How do I figure out why they are not graphing or at least get them graphing again?

Thanks!
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: A few graphs/rrds not updating on a single host

Post by gandalf »

Did you reindex the data query for that target?
R.
jkrejci
Posts: 11
Joined: Mon Sep 27, 2010 9:44 am

Re: A few graphs/rrds not updating on a single host

Post by jkrejci »

There are no interface changes on the switch (fixed config) but sometimes you never know so I tried running the following

Code: Select all

# php -q poller_reindex_hosts.php --id=9 --debug
WARNING: Do not interrupt this script.  Reindexing can take quite some time
DEBUG: There are '1' data queries to run
DEBUG: Data query number '1' host: '9' SNMP Query Id: '1' starting
DEBUG: Data query number '1' host: '9' SNMP Query Id: '1' ending
This has made no difference. Is this what you meant or is there another index you refer to?

I have also tried running the "realtime" plugin on one of the graphs in question but it never generates a graph (just a broken image) as it does for the rest. It's weird that the port 16 traffic graph is still updated as is noted in the cacti log when debug level is set. The other traffic graphs for this host might well as never have existed after December 3.

It is not too terrible to delete the graphs and data sources and then re-add them all but it would be nice to figure this out as I can't see how this could be anything other than human intervention that could have caused this condition which I would like to try and prevent from happening again.
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: A few graphs/rrds not updating on a single host

Post by gandalf »

Does "System Utilities -> View Poller Cache" show the "missing" interface data?
R.
jkrejci
Posts: 11
Joined: Mon Sep 27, 2010 9:44 am

Re: A few graphs/rrds not updating on a single host

Post by jkrejci »

No, the missing ones are not there.
Search for "Traffic" on the host in question shows only a single port twice (presume by OIDs one is for "in" the other is for "out").
Search for "Traffic" on other similar hosts shows all ports
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: A few graphs/rrds not updating on a single host

Post by gandalf »

Is it an option to completely drop that data query from the host. Then delete all related data sources for that host and re-add the data query afterwards?
R.
jkrejci
Posts: 11
Joined: Mon Sep 27, 2010 9:44 am

Re: A few graphs/rrds not updating on a single host

Post by jkrejci »

Yeah, any course of action is acceptable. Can you help me with the process you described? I can delete the data sources but how do I "drop the data query" from the host?
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: A few graphs/rrds not updating on a single host

Post by gandalf »

You edit the host. Then, at the bottom, you'll find a red cross next to the data query to delete it from the host
R.
jkrejci
Posts: 11
Joined: Mon Sep 27, 2010 9:44 am

Re: A few graphs/rrds not updating on a single host

Post by jkrejci »

Ok, I have no idea what is going on here. This is what I have done so far.
  • deleted the host in question and deleted all related data sources.
  • I went in and deleted all rrd files as well for this host. This, I believe, puts the server in a state of "cacti has absolutely no knowledge of this device" condition. I am thinking I should be good now
  • Add device
  • Fill in basic info (name, ip, host template)
  • Create Graphs For Host and choose the two Graph Template options for this host type and select all of the physical ports in the Data Query for Interface Stats. I choose graph type 'In/Out Bits (64-bit counters w/Total BW)' as was done for all of the other identical switches. Hit create. No problems.
  • Now the two host template graphs show up in the data sources and the "traffic" data sources show up.
  • look at the file system and only 2 rrd files exist for this host, the host template ones, there are none for port/traffic.
I am starting to get the feeling that my associated graph template for the "interface stats" Data Query is bad or something.
jkrejci
Posts: 11
Joined: Mon Sep 27, 2010 9:44 am

Re: A few graphs/rrds not updating on a single host

Post by jkrejci »

Yeah, apparently my associated graph template for the data query is faulty. I had created a new one called "In/Out Bits (64-bit Counters w/Total BW)" that would basically be the same as the non 64-bit equivalent but when I edit it the Associated Data Templates for "traffic_in" and "traffic_out" data sources are both stuck on "ifInOctets (Bytes In)". If I change them and hit save they both remain on "ifInOctets (Bytes In)". I would like to use 64-bit counters and have bits with total bandwidth on the graphs. Am I going about this the wrong way?
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: A few graphs/rrds not updating on a single host

Post by gandalf »

Please switch to DEBUG verbosity before hitting "save" and switch back afterwards. Find the related SQL in cacti.log. That would help debugging
R.
jkrejci
Posts: 11
Joined: Mon Sep 27, 2010 9:44 am

Re: A few graphs/rrds not updating on a single host

Post by jkrejci »

Can you indicate where to enable debug? See the attached screenshot for what I am talking about. The "Associated Data Templates" will not stay as the 64-bit counter version.
Attachments
cacti-troubleshooting.png
cacti-troubleshooting.png (136.22 KiB) Viewed 2462 times
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: A few graphs/rrds not updating on a single host

Post by gandalf »

Find it at "Settings"; see more at 2nd link of my sig
R.
GuyMontag
Posts: 2
Joined: Wed Feb 16, 2011 4:47 am
Location: Linz Austria

Re: A few graphs/rrds not updating on a single host

Post by GuyMontag »

Hi
I've the same problem as jkrejc.
I've added a new associated graph template called "In/Out Bits with Total Bandwidth 64-bit" and changed the traffic_in and out datasource to the 64 bit counters.
After hitting save both values return to "ifInOctets (Bytes In)".

If I change the datesource settings for one of the shipped associations the changes get applied.

DEBUG Output:
"In/Out Bits with Total Bandwidth 64-bit":

Code: Select all

02/16/2011 10:45:01 AM - CMDPHP: Poller[0] DEVEL: SQL Save on table 'snmp_query_graph': "a:5:{s:2:"id";s:2:"42";s:4:"hash";s:32:"8ef4ac77a69db5131e8c54ed2bc829af";s:13:"snmp_query_id";s:1:"1";s:4:"name";s:39:"In/Out Bits with Total Bandwidth 64-bit";s:17:"graph_template_id";s:3:"128";}"
In/Out Bits (64-bit Counters)

Code: Select all

02/16/2011 10:45:22 AM - CMDPHP: Poller[0] DEVEL: SQL Save on table 'snmp_query_graph': "a:5:{s:2:"id";s:2:"14";s:4:"hash";s:32:"1e16a505ddefb40356221d7a50619d91";s:13:"snmp_query_id";s:1:"1";s:4:"name";s:29:"In/Out Bits (64-bit Counters)";s:17:"graph_template_id";s:1:"2";}"
GuyMontag
Posts: 2
Joined: Wed Feb 16, 2011 4:47 am
Location: Linz Austria

Re: A few graphs/rrds not updating on a single host

Post by GuyMontag »

memo to myself: rtfm

http://www.cacti.net/downloads/docs/pdf/manual.pdf
Do not forget to check the checkbox to the right of each selection, or your
settings will not be saved.
Post Reply

Who is online

Users browsing this forum: No registered users and 6 guests