NetApp Filer: graphing Performance Stats and IO's (template)

[fsckedagain]

I just get an error when I run graph management in debug mode.

Code: Select all

RRDTool Command:
/usr/bin/rrdtool graph - \
--imgformat=PNG \
--start=-86400 \
--end=-300 \
--title="MLode-H1 -  Volume IO - |query_index|" \
--base=1000 \
--height=120 \
--width=500 \
--alt-autoscale-max \
--lower-limit=0 \
--vertical-label="Operations" \
--slope-mode \
--font TITLE:12: \
--font AXIS:8: \
--font LEGEND:10: \
--font UNIT:8: \
AREA:#8D85F3FF:"Total IOPS"  \
GPRINT::AVERAGE:"Average\:%8.2lf %s"  \
GPRINT::MAX:"max\:%8.2lf %s"  \
GPRINT::LAST:"Last\:%8.2lf %s\n"  \
LINE1:#C4FD3DFF:"Read"  \
GPRINT::AVERAGE:"      Average\:%8.2lf %s"  \
GPRINT::MAX:"Max\:%8.2lf %s"  \
GPRINT::LAST:"Last\:%8.2lf %s\n"  \
LINE1:#DE0056FF:"Writes"  \
GPRINT::AVERAGE:"    Average\:%8.2lf %s"  \
GPRINT::MAX:"Max\:%8.2lf %s"  \
GPRINT::LAST:"Last\:%8.2lf %s" 
RRDTool Says:
ERROR: parameter '#8D85F3FF' does not represent a number in line AREA:#8D85F3FF:Total IOPS

[fsckedagain]

ok, got all that fixed up, now just an issue of not knowing what the heck to do about data input method stuff. I am trying to figure it out, but it isn't happy. Also what rights does my cacti user need on the filer?

[wolf31o2]

I have been working on a SNMP version of Filer stats. It's nowhere near as complete as these are, but it uses SNMP for everything. It even detects the OnTAP version and changes code paths, since OnTAP 7.3+ supports SNMPv3 and has newer stats.

I'll attach it once I clean it up and take out all of the things I've hard-coded into it. For now, you can look at my public Git repository and grab what I have available from there. I'll be pushing in the other changes as time permits at work, so it'll always be the latest version.

NetApp Scripts/Templates on Git

[hitman6003]

Regarding the performance issues, you can resolve nearly all of it by modifying the perl script.

In the "netapp-ontapsdk-perf.pl" script, after change lines 321-322 to read:

Code: Select all

$in->child_add_string("objectname", $obj_name); # line 321

if ($obj_name ne "lun") {
  $instances = NaElement->new('instances');
  $instances->child_add_string('instance', $instance_selected);

  $in->child_add($instances);
}

$counters = NaElement->new('counters');
$counters->child_add_string('counter', $counter_selected);

$in->child_add($counters);

$out = $s->invoke_elem($in); # original line 322

In the original script, it queries the netapp for all instances of an object (volume, lun, etc) and all counters for each of those instances. What the above does is limit it to just the requested counter, and if we aren't querying for a lun, only the specific instance of the object.

The reason this doesn't work with luns is because they have strange names...like "/vol/volA/lun_name.lun : AbCdXySomeThing". The script strips off everything after the ".lun", so you don't see it on the graphs, but since it's part of the lun name on the netapp, it's required if we want to query for just a single instance. Since we don't have that data, when a lun is queried, we retrieve all luns (with just the one counter we want) and search for the instance we want.

Prior to the above modification the script took about 2.1 seconds per query to run on my server (a single CPU virtual machine w/1 GB RAM running RHEL4). Afterward, it took < .2 seconds for non lun queries, and about .4 for luns.

[fsckedagain]

I still haven't gotten the data input method thing figured out. All the other templates I have looked at have that already set up. Or at least I didn't have to create one.

[fsckedagain]

ok, snow I see what's going on with Data Input Methods, it is already set up.

But I still am getting NaN's. I acan run the script manually and get the answer, but the poller never tries to run this, just the default localhost ones.

[adamshand]

NetApp Scripts/Templates on Git

This looks great, thanks for posting it. Any chance of a quick readme on what all the bits are for?

Cheers,
Adam.

[eschoeller]

Sorry if this is off-topic..

hitman, thanks for the tip on performance - it helped a lot. It cut my inbound traffic by 50% and decreased my poller runtime by 25% !

[eschoeller]

fsckedagain: Sometimes clearing the poller cache can help. Other than that, turn up the debugging output and disable all other hosts (if you can) to easily isolate what the problem could be.

[fsckedagain]

Just as a follow up, everything wasn't working basically because I am an idiot.

What was happening is the host never got detected. If I ran a query in debug mode by clicking "create graphs"->"run query in debug mode" it would detect the host and work fine.

[fsckedagain]

Sorry for the double post, but the numbers are nowhere near jiving with what Operation Manager is saying as far as latency goes. I think everything is off 1 digit.

[kkoduru]

I am not seeing any information (like the x-axis and y-axis scale). It just shows a graph without any data. Is there something that need to be enabled?

Thanks

[gandalf]

Is this rrdtool 1.2.28? If yes, please downgrade to 1.2.27. It's a known rrdtool issue
Reinhard

[wolf31o2]

NetApp Scripts/Templates on Git

This looks great, thanks for posting it. Any chance of a quick readme on what all the bits are for?

Cheers,
Adam.

It's quite simple. Copy the things under scripts to <path_cacti>/scripts, and copy the things under script_server and snmp_queries to their directories under <path_cacti>/resource. After that, you import the templates, which I need to update with my latest changes. In fact, I need to upload some newer scripts and such, too.

I'm planning on supporting everything that I can via several methods.

- SNMPv1 for ONTAP versions prior to 7.3
- SNMPv2/v3 using 64-bit counters for 7.3 and above
- ONTAP Manage API for people who prefer it
- SMI-S Agent scripts for SMI-S software

Of course, I'm open to any help anyone wants to give, and everything I've written is released under the GPLv2. I am adding an installer script to it, and I could use some help with documentation, too. I'd like for the installer to detect the available methods and do some initial setup based on that, so it should work out of the box for everybody, and all they should need to know is the IP addresses of their Filers and the location of their Cacti installation.

[gouravjoshi]

Hi,

Thanks for a good resource to monitor Netapp on Cacti. I configured it but I'm facing 1 problem with graph template when i import it. I'm getting the below error(In bold);

#######################
Graph Template
[success] NetApp - CPU % Busy [update]
[success] NetApp - NFS Ops [update]
[success] NetApp - Cache Age [update]
[success] NetApp - FCP Ops [update]
[success] NetApp - CIFS Ops [update]
[success] NetApp - HTTP Ops [update]
[success] NetApp - iSCSI Ops [update]
[success] NetApp - Disk Counts [update]
[success] NetApp - Context switches/Interrupt [update]
[success] NetApp - FCP Read/Write Bytes [update]
[success] NetApp - iSCSI Read/Write Bytes [update]
[success] Interface - Errors/Discards [update]
[success] Interface - Unicast Packets [update]
[success] Interface - Non-Unicast Packets [update]
[success] Interface - Traffic (bytes/sec) [update]
[success] Interface - Traffic (bytes/sec, Total Bandwidth) [update]
[success] Interface - Traffic (bits/sec) [update]
[success] Interface - Traffic (bits/sec, 95th Percentile) [update]
[success] Interface - Traffic (bits/sec, Total Bandwidth) [update]
[success] Interface - Traffic (bytes/sec) - 0.6.x [update]
+ Unmet Dependency: (Data Template Item) |
+ Found Dependency: (GPRINT Preset) Normal |
+ Unmet Dependency: (Data Template Item) |
+ Unmet Dependency: (Data Template Item) |
+ Unmet Dependency: (Data Template Item) |
+ Unmet Dependency: (Data Template Item) |
+ Unmet Dependency: (Data Template Item) |
+ Unmet Dependency: (Data Template Item) |
+ Unmet Dependency: (Data Template Item) |
[success] Interface - Traffic - In/Out and Errors/Discards [update]
[success] Netapp - Volumes - KByte Usage [update]
[success] Netapp - Volumes - Files [update]
[success] Netapp - Volumes - Inodes [update]
[success] Netapp - Volumes - Usage (SIS) [update]
[success] NetApp - LUN - Ops [update]
[success] NetApp - LUN - Read/Write Bytes [update]

Data Query
[success] SNMP - Interface Statistics [update]
[success] NetApp - Volumes [update]
[success] NetApp - LUNs [update]



I'm not able to get ISCSI IO , NFS Ops, etc graphs . also the volume and lun details not coming through verbose too. Please advice .