ApacheStats 0.8.2 (multiple RRD, Low hdd, Script Server)

[helzerr]

Many of my web servers run under 1% CPU load most of the time. I thought it was odd the CPU utilization graphs were always 0.00, until I looked at the code in ss_apache_stats.php and saw the CPU load output is rounded down by the floor() function. I removed the floor() function and now I see data in the graphs.

Is there some reason it was decided to floor() the CPU utilization value in the script?

[linebacker2]

Hi I am trying to get Apache stats to work. I successfully imported everything and followed the instructions for the updates for graphs D and F.
Graphs A, B, C are displaying graphs but no data is being collected. Graphs D, E, F, G are not even displaying graphs.

I am running Cacti 0.8.7d. My other graphs in cacti are working snmp with the windows and unix templates.

When I turn Graph Debug on RRDTool for graphs A, B, and C say OK.
- RRDTool for Graph D says: ERROR: invalid rpn expression in: c,UN,0,c,100000,GT,0,c,IF,IF
- RRDTool for Graph E says: ERROR: opening '/usr/share/cacti/rra/2/306.rrd': No such file or directory
- RRDTool for Graph F says: ERROR: invalid rpn expression in: c,UN,0,c,100000,GT,0,c,IF,IF
- RRDTool for Graph G says: ERROR: opening '/usr/share/cacti/rra/2/307.rrd': No such file or directory

I get the correct output with php ss_apache_stats.php 127.0.0.1
I also get the correct output when I hit another web server that has apache stats enabled.

What am I missing here?

[spkane]

After trying to get these working and reading through all the posts, I though that I would upload an updated ZIP with all the files and various fixes, plus a very rough description of said fixes and how to apply them and get things configured correctly.

I hope it helps and will lead to a 0.82 in the near future that is better documented and a bit more usable out of the box.

Sean

[spkane]

So, I think I've found the problem causing this error:

ERROR: invalid rpn expression in: c,UN,0,c,100000,GT,0,c,IF,IF

for a lot of us with the "fixed" d & f graphs. What I don't know is exactly how to fix it in Cacti yet.

My debug output looks something like this for one of the broken graphs:

Code: Select all

/usr/bin/rrdtool graph - --imgformat=PNG --start=1243975302 --end=1244061702 --title="p3-g2t0082 (Rubblo ITG App-GreenSQL) - Apache Stats - D - Bytes / Hit" --base=1024 --height=120 --width=500 --alt-autoscale-max --lower-limit=0 COMMENT:"From 2009/06/02 20\:41\:42 To 2009/06/03 20\:41\:42\c" COMMENT:"  \n" --vertical-label="bytes per hit" --slope-mode --font TITLE:12: --font AXIS:8: --font LEGEND:10: --font UNIT:8: DEF:a="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_kbytes_2552.rrd":apache_total_kbytes:AVERAGE DEF:b="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_hits_2551.rrd":apache_total_hits:AVERAGE CDEF:cdefa=a,UN,0,a,100000,GT,0,a,IF,IF CDEF:cdefc=c,UN,0,c,100000,GT,0,c,IF,IF CDEF:cdefe=cdefc,0,EQ,0,cdefa,1024,*,cdefc,/,IF,0,1000000,LIMIT,0,1000000,LIMIT CDEF:cdefbc=a,0,0,LIMIT CDEF:cdefbg=b,0,0,LIMIT     AREA:cdefe#4123A1FF:"Bytes / Hit"  AREA:cdefe#4123A1FF:"Bytes / Hit"  GPRINT:cdefe:LAST:"Current\:%8.2lf %s"  GPRINT:cdefe:LAST:"Current\:%8.2lf %s"  GPRINT:cdefe:AVERAGE:"Average\:%8.2lf
 %s"  GPRINT:cdefe:AVERAGE:"Average\:%8.2lf %s"  GPRINT:cdefe:MAX:"Maximum\:%8.2lf %s\n"  GPRINT:cdefe:MAX:"Maximum\:%8.2lf %s\n"  LINE2:cdefbc#FF0000FF:"kBytes"  GPRINT:a:LAST:"     Current\:%8.2lf %s"  GPRINT:a:AVERAGE:"Average\:%8.2lf %s"  GPRINT:a:MAX:"Maximum\:%8.2lf %s\n"  LINE2:cdefbg#00FF00FF:"Hits"  GPRINT:b:LAST:"       Current\:%8.2lf %s"  GPRINT:b:AVERAGE:"Average\:%8.2lf %s"  GPRINT:b:MAX:"Maximum\:%8.2lf %s\n"  

Running this will produce the error:

ERROR: invalid rpn expression in: c,UN,0,c,100000,GT,0,c,IF,IF

Changing one letter on the command line causes it to produce output (which I think is valid, but I barely understand the details of this CDEF stuff).

The attribute I am changing is:
DEF:b="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_hits_2551.rrd":apache_total_hits:AVERAGE

and instead setting it to:
DEF:c="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_hits_2551.rrd":apache_total_hits:AVERAGE

Code: Select all

/usr/bin/rrdtool graph - --imgformat=PNG --start=1243975302 --end=1244061702 --title="p3-g2t0082 (Rubblo ITG App-GreenSQL) - Apache Stats - D - Bytes / Hit" --base=1024 --height=120 --width=500 --alt-autoscale-max --lower-limit=0 COMMENT:"From 2009/06/02 20\:41\:42 To 2009/06/03 20\:41\:42\c" COMMENT:"  \n" --vertical-label="bytes per hit" --slope-mode --font TITLE:12: --font AXIS:8: --font LEGEND:10: --font UNIT:8: DEF:a="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_kbytes_2552.rrd":apache_total_kbytes:AVERAGE DEF:c="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_hits_2551.rrd":apache_total_hits:AVERAGE CDEF:cdefa=a,UN,0,a,100000,GT,0,a,IF,IF CDEF:cdefc=c,UN,0,c,100000,GT,0,c,IF,IF CDEF:cdefe=cdefc,0,EQ,0,cdefa,1024,*,cdefc,/,IF,0,1000000,LIMIT,0,1000000,LIMIT CDEF:cdefbc=a,0,0,LIMIT CDEF:cdefbg=b,0,0,LIMIT     AREA:cdefe#4123A1FF:"Bytes / Hit"  AREA:cdefe#4123A1FF:"Bytes / Hit"  GPRINT:cdefe:LAST:"Current\:%8.2lf %s"  GPRINT:cdefe:LAST:"Current\:%8.2lf %s"  GPRINT:cdefe:AVERAGE:"Average\:%8.2lf
 %s"  GPRINT:cdefe:AVERAGE:"Average\:%8.2lf %s"  GPRINT:cdefe:MAX:"Maximum\:%8.2lf %s\n"  GPRINT:cdefe:MAX:"Maximum\:%8.2lf %s\n"  LINE2:cdefbc#FF0000FF:"kBytes"  GPRINT:a:LAST:"     Current\:%8.2lf %s"  GPRINT:a:AVERAGE:"Average\:%8.2lf %s"  GPRINT:a:MAX:"Maximum\:%8.2lf %s\n"  LINE2:cdefbg#00FF00FF:"Hits"  GPRINT:b:LAST:"       Current\:%8.2lf %s"  GPRINT:b:AVERAGE:"Average\:%8.2lf %s"  GPRINT:b:MAX:"Maximum\:%8.2lf %s\n"  

Anyone know how to fix this within cacti or the xml template?

Thanks,
Sean

[kilos]

So, I think I've found the problem causing this error:

ERROR: invalid rpn expression in: c,UN,0,c,100000,GT,0,c,IF,IF

for a lot of us with the "fixed" d & f graphs. What I don't know is exactly how to fix it in Cacti yet.

My debug output looks something like this for one of the broken graphs:

Code: Select all

/usr/bin/rrdtool graph - --imgformat=PNG --start=1243975302 --end=1244061702 --title="p3-g2t0082 (Rubblo ITG App-GreenSQL) - Apache Stats - D - Bytes / Hit" --base=1024 --height=120 --width=500 --alt-autoscale-max --lower-limit=0 COMMENT:"From 2009/06/02 20\:41\:42 To 2009/06/03 20\:41\:42\c" COMMENT:"  \n" --vertical-label="bytes per hit" --slope-mode --font TITLE:12: --font AXIS:8: --font LEGEND:10: --font UNIT:8: DEF:a="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_kbytes_2552.rrd":apache_total_kbytes:AVERAGE DEF:b="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_hits_2551.rrd":apache_total_hits:AVERAGE CDEF:cdefa=a,UN,0,a,100000,GT,0,a,IF,IF CDEF:cdefc=c,UN,0,c,100000,GT,0,c,IF,IF CDEF:cdefe=cdefc,0,EQ,0,cdefa,1024,*,cdefc,/,IF,0,1000000,LIMIT,0,1000000,LIMIT CDEF:cdefbc=a,0,0,LIMIT CDEF:cdefbg=b,0,0,LIMIT     AREA:cdefe#4123A1FF:"Bytes / Hit"  AREA:cdefe#4123A1FF:"Bytes / Hit"  GPRINT:cdefe:LAST:"Current\:%8.2lf %s"  GPRINT:cdefe:LAST:"Current\:%8.2lf %s"  GPRINT:cdefe:AVERAGE:"Average\:%8.2lf
 %s"  GPRINT:cdefe:AVERAGE:"Average\:%8.2lf %s"  GPRINT:cdefe:MAX:"Maximum\:%8.2lf %s\n"  GPRINT:cdefe:MAX:"Maximum\:%8.2lf %s\n"  LINE2:cdefbc#FF0000FF:"kBytes"  GPRINT:a:LAST:"     Current\:%8.2lf %s"  GPRINT:a:AVERAGE:"Average\:%8.2lf %s"  GPRINT:a:MAX:"Maximum\:%8.2lf %s\n"  LINE2:cdefbg#00FF00FF:"Hits"  GPRINT:b:LAST:"       Current\:%8.2lf %s"  GPRINT:b:AVERAGE:"Average\:%8.2lf %s"  GPRINT:b:MAX:"Maximum\:%8.2lf %s\n"  

Running this will produce the error:

ERROR: invalid rpn expression in: c,UN,0,c,100000,GT,0,c,IF,IF

Changing one letter on the command line causes it to produce output (which I think is valid, but I barely understand the details of this CDEF stuff).

The attribute I am changing is:
DEF:b="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_hits_2551.rrd":apache_total_hits:AVERAGE

and instead setting it to:
DEF:c="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_hits_2551.rrd":apache_total_hits:AVERAGE

Code: Select all

/usr/bin/rrdtool graph - --imgformat=PNG --start=1243975302 --end=1244061702 --title="p3-g2t0082 (Rubblo ITG App-GreenSQL) - Apache Stats - D - Bytes / Hit" --base=1024 --height=120 --width=500 --alt-autoscale-max --lower-limit=0 COMMENT:"From 2009/06/02 20\:41\:42 To 2009/06/03 20\:41\:42\c" COMMENT:"  \n" --vertical-label="bytes per hit" --slope-mode --font TITLE:12: --font AXIS:8: --font LEGEND:10: --font UNIT:8: DEF:a="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_kbytes_2552.rrd":apache_total_kbytes:AVERAGE DEF:c="/var/www/cacti/rra/p3-g2t0082_rubblo_itg_app-greensql_apache_total_hits_2551.rrd":apache_total_hits:AVERAGE CDEF:cdefa=a,UN,0,a,100000,GT,0,a,IF,IF CDEF:cdefc=c,UN,0,c,100000,GT,0,c,IF,IF CDEF:cdefe=cdefc,0,EQ,0,cdefa,1024,*,cdefc,/,IF,0,1000000,LIMIT,0,1000000,LIMIT CDEF:cdefbc=a,0,0,LIMIT CDEF:cdefbg=b,0,0,LIMIT     AREA:cdefe#4123A1FF:"Bytes / Hit"  AREA:cdefe#4123A1FF:"Bytes / Hit"  GPRINT:cdefe:LAST:"Current\:%8.2lf %s"  GPRINT:cdefe:LAST:"Current\:%8.2lf %s"  GPRINT:cdefe:AVERAGE:"Average\:%8.2lf
 %s"  GPRINT:cdefe:AVERAGE:"Average\:%8.2lf %s"  GPRINT:cdefe:MAX:"Maximum\:%8.2lf %s\n"  GPRINT:cdefe:MAX:"Maximum\:%8.2lf %s\n"  LINE2:cdefbc#FF0000FF:"kBytes"  GPRINT:a:LAST:"     Current\:%8.2lf %s"  GPRINT:a:AVERAGE:"Average\:%8.2lf %s"  GPRINT:a:MAX:"Maximum\:%8.2lf %s\n"  LINE2:cdefbg#00FF00FF:"Hits"  GPRINT:b:LAST:"       Current\:%8.2lf %s"  GPRINT:b:AVERAGE:"Average\:%8.2lf %s"  GPRINT:b:MAX:"Maximum\:%8.2lf %s\n"  

Anyone know how to fix this within cacti or the xml template?

Thanks,
Sean

Ok , I apologize for my English.

First Error for graph D
ERROR: invalid rpn expression in: c,UN,0,c,100000,GT,0,c,IF,IF

You create the new CDEF's
Name :Apache08 - Clean value for DEF b
type: Custom String
value: cdef=b,UN,0,b,100000,GT,0,b,IF,IF

Now enter in "Graph Templates" and search "WebServer - ApacheStats08 - D"
Modify the "CDEF Function" in "item 3" and "item 4"
"Apache08 - Clean value for DEF c" to "Apache08 - Clean value for DEF b"

Same procedure for graph F

This should resolve the problem

[linebacker2]

That worked!!! The combined steps together worked. Thanks!

[portos67]

hellooooooooo!!!!!

I have a big problem with ss_apache_stats

When i created the graph he appears NAN but the debug mode is OK.

My question is : How i configure apache for all hosts ?

I changed /etc/apache2/httpd.conf but no succefuly

i add this confiration for all hosts :

<Location /var/www/html/cacti>
SetHandler server-status
Order deny,allow
Deny from all
Allow from @IP server who cacti installed
</Location>


Help me PLEASE !!!!!!!!!!!!!

Contact me with mail (portos67@msn.com) or forum

[DK]

Good morning all,

So I've installed the script but I'm getting an error in the cacti log:

Code: Select all

07/22/2009 09:40:02 AM - CMDPHP: Poller[0] Host[6] DS[47] WARNING: Result from SERVER not valid. Partial Result: U 

When I run the script from the cli I get:

Code: Select all

apache_total_hits:236 apache_total_kbytes:1809 apache_cpuload:1.01216 apache_busy_workers:3 apache_idle_workers:8 thread_W:8 threadS:0 threadR:0 threadW:1 threadK:2 threadD:0 threadC:0 threadL:0 threadG:0 threadI:0 thread_O:245

I can also access the server-status page on the remote server so the apache config is correct.

I have looked all over and have not found a solution posted. Please excuse this post if the solution has been posted previously.

Also I'm running cacti 8.7d.

Cheers!

[lukeren]

hellooooooooo!!!!!

I have a big problem with ss_apache_stats

When i created the graph he appears NAN but the debug mode is OK.

My question is : How i configure apache for all hosts ?

I changed /etc/apache2/httpd.conf but no succefuly

i add this confiration for all hosts :

<Location /var/www/html/cacti>
SetHandler server-status
Order deny,allow
Deny from all
Allow from @IP server who cacti installed
</Location>


Help me PLEASE !!!!!!!!!!!!!

Contact me with mail (portos67@msn.com) or forum

It needs to be:

Code: Select all

<Location /server-status>
SetHandler server-status
Order deny,allow
Deny from all
Allow from @IP server who cacti installed
</Location>

-

I've got problems getting graph D and F to work, I've tried all of the "fixes" here, but nothing helps.

I noticed this in the log file:

Code: Select all

08/30/2009 01:55:02 PM - SYSTEM STATS: Time:1.2879 Method:cmd.php Processes:1 Threads:N/A Hosts:2 HostsPerProcess:2 DataSources:15 RRDsProcessed:14

The Threads part has me thinking something isn't right, and the data is only partial since it says N/A, but I have no idea what I can do to figure it out.

[RCK]

A little post to tell you I released a new version of ApacheStats.
It have been exported with cacti 0.8.7e and include every fix submitted since last release
A big thanks to everyone who have find all those fixes.

Update procedure in first post: http://forums.cacti.net/about25227.html

[cskp12]

I've found the problem causing this error:

ERROR: invalid rpn expression in: cdefe,0,EQ,0,cdefa,100,*,cdefe,/,IF,0,110,LIMIT

for a lot of us with the "fixed" f graphs. What I don't know is exactly how to fix it in Cacti yet.

What am I missing here

my cacti server config below
quote]Cacti Version - 0.8.7e
Plugin Architecture - 2.5
Poller Type - CMD.php
Server Info - Windows NT 5.2
Web Server - Apache/2.2.11 (Win32) DAV/2 PHP/5.2.10 mod_uptime/0.1.1
PHP - 5.2.10
PHP Extensions - bcmath, calendar, com_dotnet, ctype, date, filter, ftp, hash, iconv, json, odbc, pcre, Reflection, session, libxml, standard, tokenizer, zlib, SimpleXML, dom, SPL, wddx, xml, xmlreader, xmlwriter, apache2handler, bz2, curl, dba, dbase, fdf, gd, gettext, gmp, imap, interbase, ldap, mbstring, mcrypt, mhash, mime_magic, ming, mysql, mysqli, openssl, shmop, snmp, soap, sockets, tidy, xmlrpc, xsl, zip, exif, memcache, eAccelerator, Zend Optimizer
MySQL - 5.0.81-community-nt
RRDTool - 1.2.30
SNMP - snmpwalk [OPTIONS] AGENT [OID]

Version: 5.4.2.1
Web: http://www.net-snmp.org/
Email: net-snmp-coders@lists.sourceforge.net

OPTIONS:
-h, --help display this help message
-H display configuration file directives understood
-v 1|2c|3 specifies SNMP version to use
-V, --version display package version number
SNMP Version 1 or 2c specific
-c COMMUNITY set the community string
SNMP Version 3 specific
-a PROTOCOL set authentication protocol (MD5|SHA)
-A PASSPHRASE set authentication protocol pass phrase
-e ENGINE-ID set security engine ID (e.g. 800000020109840301)
-E ENGINE-ID set context engine ID (e.g. 800000020109840301)
-l LEVEL set security level (noAuthNoPriv|authNoPriv|authPriv)
-n CONTEXT set context name (e.g. bridge1)
-u USER-NAME set security name (e.g. bert)
-x PROTOCOL set privacy protocol (DES)
-X PASSPHRASE set privacy protocol pass phrase
-Z BOOTS,TIME set destination engine boots/time
General communication options
-r RETRIES set the number of retries
-t TIMEOUT set the request timeout (in seconds)
Debugging
-d dump input/output packets in hexadecimal
-D TOKEN[,...] turn on debugging output for the specified TOKENs
(ALL gives extremely verbose debugging output)
General options
-m MIB[:...] load given list of MIBs (ALL loads everything)
-M DIR[:...] look in given list of directories for MIBs
-P MIBOPTS Toggle various defaults controlling MIB parsing:
u: allow the use of underlines in MIB symbols
c: disallow the use of "--" to terminate comments
d: save the DESCRIPTIONs of the MIB objects
e: disable errors when MIB symbols conflict
w: enable warnings when MIB symbols conflict
W: enable detailed warnings when MIB symbols conflict
R: replace MIB symbols from latest module
-O OUTOPTS Toggle various defaults controlling output display:
0: print leading 0 for single-digit hex characters
a: print all strings in ascii format
b: do not break OID indexes down
e: print enums numerically
E: escape quotes in string indices
f: print full OIDs on output
n: print OIDs numerically
q: quick print for easier parsing
Q: quick print with equal-signs
s: print only last symbolic element of OID
S: print MIB module-id plus last element
t: print timeticks unparsed as numeric integers
T: print human-readable text along with hex strings
u: print OIDs using UCD-style prefix suppression
U: don't print units
v: print values only (not OID = value)
x: print all strings in hex format
X: extended index format
-I INOPTS Toggle various defaults controlling input parsing:
b: do best/regex matching to find a MIB node
h: don't apply DISPLAY-HINTs
r: do not check values for range/type legality
R: do random access to OID labels
u: top-level OIDs must have '.' prefix (UCD-style)
s SUFFIX: Append all textual OIDs with SUFFIX before parsing
S PREFIX: Prepend all textual OIDs with PREFIX before parsing
-L LOGOPTS Toggle various defaults controlling logging:
e: log to standard error
o: log to standard output
n: don't log at all
f file: log to the specified file
s facility: log to syslog (via the specified facility)

(variants)
[EON] pri: log to standard error, output or /dev/null for level 'pri' and above
[EON] p1-p2: log to standard error, output or /dev/null for levels 'p1' to 'p2'
[FS] pri token: log to file/syslog for level 'pri' and above
[FS] p1-p2 token: log to file/syslog for levels 'p1' to 'p2'
-C APPOPTS Set various application specific behaviours:
p: print the number of variables found
i: include given OID in the search range
I: don't include the given OID, even if no results are returned
c: do not check returned OIDs are increasing
t: Display wall-clock time to complete the request
Plugins

• Global Plugin Settings (settings - v0.6)
  Host Info (hostinfo - v0.2)
  Update Checker (update - v0.4)
  Network Tools (tools - v0.3)
  PHP Network Managing (PHP Network Managing - v0.6.1)
  Thresholds (thold - v0.4.1)
  Device Monitoring (monitor - v0.8.2)
  Notices (Notices - v0.2c)
  Device Status Monitoring (Status - v4)
  IP subnet Calculator IPv4 IPv6 (ipsubnet - v.4d)

[/quote]

[RCK]

I've found the problem causing this error:

ERROR: invalid rpn expression in: cdefe,0,EQ,0,cdefa,100,*,cdefe,/,IF,0,110,LIMIT

for a lot of us with the "fixed" f graphs. What I don't know is exactly how to fix it in Cacti yet.

What am I missing here

Could you try the 0.8.2 release ?
Download and upgrade instruction here: http://forums.cacti.net/about25227.html

[cskp12]

yes 0.82 release

[RCK]

If this CDEF function is not working, it's maybe because you have multiple consolidation function into your RRA's.

Please go to "Management" -> "Data Sources" -> "RRAs", and edit the 4 round robin archive to be sure you only have the AVERAGE function selected.

If it's the case, please delete the Graph + Datasource of you test serveur, and created the ApacheStats graph again.

[woueb]

Hello,
our script seems great but I cannot manage to use it : I've correctly installed it, the old Apache Stats 0.4 is working fine, but every graphs in yours are empty.

Here is a debut from the CPU Load graph

Code: Select all

/usr/bin/rrdtool graph - \
--imgformat=PNG \
--start=1256856190 \
--end=1256942590 \
--title="Server_test2 - Apache Stats - B - Hits / s" \
--base=1000 \
--height=120 \
--width=500 \
--alt-autoscale-max \
--lower-limit=0 \
COMMENT:"From 2009/10/29 23\:43\:10 To 2009/10/30 23\:43\:10\c" \
COMMENT:"  \n" \
--vertical-label="hits per sec" \
--slope-mode \
--font TITLE:12: \
--font AXIS:8: \
--font LEGEND:10: \
--font UNIT:8: \
DEF:a="/var/www/monitoringclient/production/releases/20090715-02/web/rra/server_test2_apache_total_hits_75.rrd":apache_total_hits:AVERAGE \
AREA:a#AAABA1FF:"Hits/sec"  \
GPRINT:a:LAST:"Current\:%8.2lf %s"  \
GPRINT:a:AVERAGE:"Average\:%8.2lf %s"  \
GPRINT:a:MAX:"Maximum\:%8.2lf %s\n" 

And when I execute from the command line I have a result.