Aggregate Plugin graph item limit problem

General discussion about Plugins for Cacti

Moderators: Developers, Moderators

Post Reply
mskaralar
Posts: 10
Joined: Fri Sep 17, 2010 6:55 am
Location: Turkey

Aggregate Plugin graph item limit problem

Post by mskaralar »

Hi, I have a question about aggregating graphs. I cant find o topic about this problem. I was aggregating my cacti graphs succesfully, still I can. But, while ı am trying to aggregate graph items more then 65, my graph doesnt seem (when ı add the 66th graph item!) When ı removed graph item66, my graph returns and ı can see.
Is there a limit of aggregating?

Thank you.
sorry for my poor english.

-mskaralar
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: Aggregate Plugin graph item limit problem

Post by TheWitness »

What operating system and kernel level. Yes, depending on your OS level and RRDtool version, and even possibly PHP, there are limits to the length of the input that we can provide to a program. However, to be honest, I have passed +16mb messages through a string in PHP and never had a problem. I'm thinking RRDtool might be crashing.

A good way to test this is to show the graph debug and cut and past it to the command line and see what happens.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
mskaralar
Posts: 10
Joined: Fri Sep 17, 2010 6:55 am
Location: Turkey

Re: Aggregate Plugin graph item limit problem

Post by mskaralar »

on graph debug mode, rrdtool says noting. I'm using windows server 2003 r2 sp2. here is my graph debug.

RRDTool Command:

C:/rrdtool/rrdtool.exe graph - \
--imgformat=PNG \
--start=-86400 \
--end=-300 \
--title="ToplamInternet" \
--rigid \
--base=1000 \
--height=120 \
--width=800 \
--alt-autoscale \
--vertical-label="bits per second" \
--slope-mode \
--font TITLE:12: \
--font AXIS:8: \
--font LEGEND:10: \
--font UNIT:8: \
DEF:a="C\:/Apache2/htdocs/cacti/rra/16/72.rrd":traffic_in:AVERAGE \
DEF:b="C\:/Apache2/htdocs/cacti/rra/16/72.rrd":traffic_out:AVERAGE \
DEF:c="C\:/Apache2/htdocs/cacti/rra/16/72.rrd":traffic_in:MAX \
DEF:d="C\:/Apache2/htdocs/cacti/rra/16/72.rrd":traffic_out:MAX \
DEF:e="C\:/Apache2/htdocs/cacti/rra/3/95.rrd":traffic_in:AVERAGE \
DEF:f="C\:/Apache2/htdocs/cacti/rra/3/95.rrd":traffic_out:AVERAGE \
DEF:g="C\:/Apache2/htdocs/cacti/rra/3/95.rrd":traffic_in:MAX \
DEF:h="C\:/Apache2/htdocs/cacti/rra/3/95.rrd":traffic_out:MAX \
DEF:i="C\:/Apache2/htdocs/cacti/rra/3/55.rrd":traffic_in:AVERAGE \
DEF:j="C\:/Apache2/htdocs/cacti/rra/3/55.rrd":traffic_out:AVERAGE \
DEF:ba="C\:/Apache2/htdocs/cacti/rra/3/55.rrd":traffic_in:MAX \
DEF:bb="C\:/Apache2/htdocs/cacti/rra/3/55.rrd":traffic_out:MAX \
DEF:bc="C\:/Apache2/htdocs/cacti/rra/5/59.rrd":traffic_in:AVERAGE \
DEF:bd="C\:/Apache2/htdocs/cacti/rra/5/59.rrd":traffic_out:AVERAGE \
DEF:be="C\:/Apache2/htdocs/cacti/rra/5/59.rrd":traffic_in:MAX \
DEF:bf="C\:/Apache2/htdocs/cacti/rra/5/59.rrd":traffic_out:MAX \
DEF:bg="C\:/Apache2/htdocs/cacti/rra/5/50.rrd":traffic_in:AVERAGE \
DEF:bh="C\:/Apache2/htdocs/cacti/rra/5/50.rrd":traffic_out:AVERAGE \
DEF:bi="C\:/Apache2/htdocs/cacti/rra/5/50.rrd":traffic_in:MAX \
DEF:bj="C\:/Apache2/htdocs/cacti/rra/5/50.rrd":traffic_out:MAX \
DEF:ca="C\:/Apache2/htdocs/cacti/rra/5/51.rrd":traffic_in:AVERAGE \
DEF:cb="C\:/Apache2/htdocs/cacti/rra/5/51.rrd":traffic_out:AVERAGE \
DEF:cc="C\:/Apache2/htdocs/cacti/rra/5/51.rrd":traffic_in:MAX \
DEF:cd="C\:/Apache2/htdocs/cacti/rra/5/51.rrd":traffic_out:MAX \
DEF:ce="C\:/Apache2/htdocs/cacti/rra/5/11.rrd":traffic_in:AVERAGE \
DEF:cf="C\:/Apache2/htdocs/cacti/rra/5/11.rrd":traffic_out:AVERAGE \
DEF:cg="C\:/Apache2/htdocs/cacti/rra/5/11.rrd":traffic_in:MAX \
DEF:ch="C\:/Apache2/htdocs/cacti/rra/5/11.rrd":traffic_out:MAX \
DEF:ci="C\:/Apache2/htdocs/cacti/rra/5/12.rrd":traffic_in:AVERAGE \
DEF:cj="C\:/Apache2/htdocs/cacti/rra/5/12.rrd":traffic_out:AVERAGE \
DEF:da="C\:/Apache2/htdocs/cacti/rra/5/12.rrd":traffic_in:MAX \
DEF:db="C\:/Apache2/htdocs/cacti/rra/5/12.rrd":traffic_out:MAX \
DEF:dc="C\:/Apache2/htdocs/cacti/rra/5/13.rrd":traffic_in:AVERAGE \
DEF:dd="C\:/Apache2/htdocs/cacti/rra/5/13.rrd":traffic_out:AVERAGE \
DEF:de="C\:/Apache2/htdocs/cacti/rra/5/13.rrd":traffic_in:MAX \
DEF:df="C\:/Apache2/htdocs/cacti/rra/5/13.rrd":traffic_out:MAX \
DEF:dg="C\:/Apache2/htdocs/cacti/rra/5/14.rrd":traffic_in:AVERAGE \
DEF:dh="C\:/Apache2/htdocs/cacti/rra/5/14.rrd":traffic_out:AVERAGE \
DEF:di="C\:/Apache2/htdocs/cacti/rra/5/14.rrd":traffic_in:MAX \
DEF:dj="C\:/Apache2/htdocs/cacti/rra/5/14.rrd":traffic_out:MAX \
DEF:ea="C\:/Apache2/htdocs/cacti/rra/5/15.rrd":traffic_in:AVERAGE \
DEF:eb="C\:/Apache2/htdocs/cacti/rra/5/15.rrd":traffic_out:AVERAGE \
DEF:ec="C\:/Apache2/htdocs/cacti/rra/5/15.rrd":traffic_in:MAX \
DEF:ed="C\:/Apache2/htdocs/cacti/rra/5/15.rrd":traffic_out:MAX \
DEF:ee="C\:/Apache2/htdocs/cacti/rra/5/57.rrd":traffic_in:AVERAGE \
DEF:ef="C\:/Apache2/htdocs/cacti/rra/5/57.rrd":traffic_out:AVERAGE \
DEF:eg="C\:/Apache2/htdocs/cacti/rra/5/57.rrd":traffic_in:MAX \
DEF:eh="C\:/Apache2/htdocs/cacti/rra/5/57.rrd":traffic_out:MAX \
DEF:ei="C\:/Apache2/htdocs/cacti/rra/7/163.rrd":traffic_in:AVERAGE \
DEF:ej="C\:/Apache2/htdocs/cacti/rra/7/163.rrd":traffic_out:AVERAGE \
CDEF:cdefa=a,8,* \
CDEF:cdefb=b,8,* \
CDEF:cdefc=c,8,* \
CDEF:cdefd=d,8,* \
CDEF:cdefe=e,8,* \
CDEF:cdeff=f,8,* \
CDEF:cdefg=g,8,* \
CDEF:cdefh=h,8,* \
CDEF:cdefi=i,8,* \
CDEF:cdefj=j,8,* \
CDEF:cdefba=ba,8,* \
CDEF:cdefbb=bb,8,* \
CDEF:cdefbc=bc,8,* \
CDEF:cdefbd=bd,8,* \
CDEF:cdefbe=be,8,* \
CDEF:cdefbf=bf,8,* \
CDEF:cdefbg=bg,8,* \
CDEF:cdefbh=bh,8,* \
CDEF:cdefbi=bi,8,* \
CDEF:cdefbj=bj,8,* \
CDEF:cdefca=ca,8,* \
CDEF:cdefcb=cb,8,* \
CDEF:cdefcc=cc,8,* \
CDEF:cdefcd=cd,8,* \
CDEF:cdefce=ce,8,* \
CDEF:cdefcf=cf,8,* \
CDEF:cdefcg=cg,8,* \
CDEF:cdefch=ch,8,* \
CDEF:cdefci=ci,8,* \
CDEF:cdefcj=cj,8,* \
CDEF:cdefda=da,8,* \
CDEF:cdefdb=db,8,* \
CDEF:cdefdc=dc,8,* \
CDEF:cdefdd=dd,8,* \
CDEF:cdefde=de,8,* \
CDEF:cdefdf=df,8,* \
CDEF:cdefdg=dg,8,* \
CDEF:cdefdh=dh,8,* \
CDEF:cdefdi=di,8,* \
CDEF:cdefdj=dj,8,* \
CDEF:cdefea=ea,8,* \
CDEF:cdefeb=eb,8,* \
CDEF:cdefec=ec,8,* \
CDEF:cdefed=ed,8,* \
CDEF:cdefee=ee,8,* \
CDEF:cdefef=ef,8,* \
CDEF:cdefeg=eg,8,* \
CDEF:cdefeh=eh,8,* \
CDEF:cdefei=TIME,1287381061,GT,a,a,UN,0,a,IF,IF,TIME,1287381061,GT,e,e,UN,0,e,IF,IF,TIME,1287381061,GT,i,i,UN,0,i,IF,IF,TIME,1287381061,GT,bc,bc,UN,0,bc,IF,IF,TIME,1287381061,GT,bg,bg,UN,0,bg,IF,IF,TIME,1287381061,GT,ca,ca,UN,0,ca,IF,IF,TIME,1287381061,GT,ce,ce,UN,0,ce,IF,IF,TIME,1287381061,GT,ci,ci,UN,0,ci,IF,IF,TIME,1287381061,GT,dc,dc,UN,0,dc,IF,IF,TIME,1287381061,GT,dg,dg,UN,0,dg,IF,IF,TIME,1287381061,GT,ea,ea,UN,0,ea,IF,IF,TIME,1287381061,GT,ee,ee,UN,0,ee,IF,IF,TIME,1287381061,GT,ei,ei,UN,0,ei,IF,IF,+,+,+,+,+,+,+,+,+,+,+,+,8,* \
CDEF:cdeffc=TIME,1287381061,GT,b,b,UN,0,b,IF,IF,TIME,1287381061,GT,f,f,UN,0,f,IF,IF,TIME,1287381061,GT,j,j,UN,0,j,IF,IF,TIME,1287381061,GT,bd,bd,UN,0,bd,IF,IF,TIME,1287381061,GT,bh,bh,UN,0,bh,IF,IF,TIME,1287381061,GT,cb,cb,UN,0,cb,IF,IF,TIME,1287381061,GT,cf,cf,UN,0,cf,IF,IF,TIME,1287381061,GT,cj,cj,UN,0,cj,IF,IF,TIME,1287381061,GT,dd,dd,UN,0,dd,IF,IF,TIME,1287381061,GT,dh,dh,UN,0,dh,IF,IF,TIME,1287381061,GT,eb,eb,UN,0,eb,IF,IF,TIME,1287381061,GT,ef,ef,UN,0,ef,IF,IF,TIME,1287381061,GT,ej,ej,UN,0,ej,IF,IF,+,+,+,+,+,+,+,+,+,+,+,+,8,* \
CDEF:cdeffg=TIME,1287381061,GT,c,c,UN,0,c,IF,IF,TIME,1287381061,GT,g,g,UN,0,g,IF,IF,TIME,1287381061,GT,ba,ba,UN,0,ba,IF,IF,TIME,1287381061,GT,be,be,UN,0,be,IF,IF,TIME,1287381061,GT,bi,bi,UN,0,bi,IF,IF,TIME,1287381061,GT,cc,cc,UN,0,cc,IF,IF,TIME,1287381061,GT,cg,cg,UN,0,cg,IF,IF,TIME,1287381061,GT,da,da,UN,0,da,IF,IF,TIME,1287381061,GT,de,de,UN,0,de,IF,IF,TIME,1287381061,GT,di,di,UN,0,di,IF,IF,TIME,1287381061,GT,ec,ec,UN,0,ec,IF,IF,TIME,1287381061,GT,eg,eg,UN,0,eg,IF,IF,+,+,+,+,+,+,+,+,+,+,+,8,* \
CDEF:cdefga=TIME,1287381061,GT,d,d,UN,0,d,IF,IF,TIME,1287381061,GT,h,h,UN,0,h,IF,IF,TIME,1287381061,GT,bb,bb,UN,0,bb,IF,IF,TIME,1287381061,GT,bf,bf,UN,0,bf,IF,IF,TIME,1287381061,GT,bj,bj,UN,0,bj,IF,IF,TIME,1287381061,GT,cd,cd,UN,0,cd,IF,IF,TIME,1287381061,GT,ch,ch,UN,0,ch,IF,IF,TIME,1287381061,GT,db,db,UN,0,db,IF,IF,TIME,1287381061,GT,df,df,UN,0,df,IF,IF,TIME,1287381061,GT,dj,dj,UN,0,dj,IF,IF,TIME,1287381061,GT,ed,ed,UN,0,ed,IF,IF,TIME,1287381061,GT,eh,eh,UN,0,eh,IF,IF,+,+,+,+,+,+,+,+,+,+,+,8,* \
CDEF:cdefge=ei,8,* \
CDEF:cdefgf=ej,8,* \
AREA:cdefa:"" \
LINE1:cdefb:"" \
LINE1:cdefc:"" \
LINE1:cdefd:"" \
AREA:cdefe:"" \
LINE1:cdeff:"" \
LINE1:cdefg:"" \
LINE1:cdefh:"" \
AREA:cdefi:"" \
LINE1:cdefj:"" \
LINE1:cdefba:"" \
LINE1:cdefbb:"" \
AREA:cdefbc:"" \
LINE1:cdefbd:"" \
LINE1:cdefbe:"" \
LINE1:cdefbf:"" \
AREA:cdefbg:"" \
LINE1:cdefbh:"" \
LINE1:cdefbi:"" \
LINE1:cdefbj:"" \
AREA:cdefca:"" \
LINE1:cdefcb:"" \
LINE1:cdefcc:"" \
LINE1:cdefcd:"" \
AREA:cdefce:"" \
LINE1:cdefcf:"" \
LINE1:cdefcg:"" \
LINE1:cdefch:"" \
AREA:cdefci:"" \
LINE1:cdefcj:"" \
LINE1:cdefda:"" \
LINE1:cdefdb:"" \
AREA:cdefdc:"" \
LINE1:cdefdd:"" \
LINE1:cdefde:"" \
LINE1:cdefdf:"" \
AREA:cdefdg:"" \
LINE1:cdefdh:"" \
LINE1:cdefdi:"" \
LINE1:cdefdj:"" \
AREA:cdefea:"" \
LINE1:cdefeb:"" \
LINE1:cdefec:"" \
LINE1:cdefed:"" \
AREA:cdefee:"" \
LINE1:cdefef:"" \
LINE1:cdefeg:"" \
LINE1:cdefeh:"" \
AREA:cdefei#00CF00FF:"TOTAL Inbound" \
GPRINT:cdefei:LAST:" Current\:%8.2lf %s" \
GPRINT:cdefei:AVERAGE:"Average\:%8.2lf %s" \
GPRINT:cdefei:MAX:"Maximum\:%8.2lf %s\n" \
LINE1:cdeffc#002A97FF:"TOTAL Outbound" \
GPRINT:cdeffc:LAST:" Current\:%8.2lf %s" \
GPRINT:cdeffc:AVERAGE:"Average\:%8.2lf %s" \
GPRINT:cdeffc:MAX:"Maximum\:%8.2lf %s\n" \
LINE1:cdeffg#FF0000FF:"TOTAL Peak_In\:" \
GPRINT:cdeffg:LAST:" Current\:%8.2lf %s" \
GPRINT:cdeffg:AVERAGE:"Avarage\:%8.2lf %s" \
GPRINT:cdeffg:MAX:"Maximum\:%8.2lf %s\n" \
LINE1:cdefga#aa8800FF:"TOTAL Peak_Out\:" \
GPRINT:cdefga:LAST:"Current\:%8.2lf %s" \
GPRINT:cdefga:AVERAGE:"Avarage\:%8.2lf %s" \
GPRINT:cdefga:MAX:"Maximum\:%8.2lf %s\n" \
LINE1:cdefge:"" \
LINE1:cdefgf:""
RRDTool Says:
mskaralar
Posts: 10
Joined: Fri Sep 17, 2010 6:55 am
Location: Turkey

Re: Aggregate Plugin graph item limit problem

Post by mskaralar »

I have read about this topics in [HOWTO] Cacti's setup for really BIG environments http://forums.cacti.net/about29707.html

#The memory allocated to store results from old queries.
query_cache_size=16M
#Don't cache results that are bigger than this.
query_cache_limit=1M
#Query cache type to use.
query_cache_type=1


This can be a solution for me?
User avatar
BSOD2600
Cacti Moderator
Posts: 12171
Joined: Sat May 08, 2004 12:44 pm
Location: USA

Re: Aggregate Plugin graph item limit problem

Post by BSOD2600 »

I suspect you're reaching the Windows command line limit of 8191 characters.
mskaralar
Posts: 10
Joined: Fri Sep 17, 2010 6:55 am
Location: Turkey

Re: Aggregate Plugin graph item limit problem

Post by mskaralar »

Thank you for reply. Now, there is a solution ı think about. To define envirenmental variable for "C\:/Apache2/htdocs/cacti/rra/" . When I define "rra" for this path, the character count is going to be less. Defining variable in windows is easy but how can I say cacti to use this "rra" variable instead of the path "C\:/Apache2/htdocs/cacti/rra/"? I'm waiting for your answers.

Thank you.
Last edited by mskaralar on Sat Sep 03, 2011 4:18 am, edited 1 time in total.
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: Aggregate Plugin graph item limit problem

Post by gandalf »

Unfortunately, you can't without changing code. If you want to change code, see lib/rrd.php
R.
mskaralar
Posts: 10
Joined: Fri Sep 17, 2010 6:55 am
Location: Turkey

Re: Aggregate Plugin graph item limit problem

Post by mskaralar »

I cant find howto change rrd path in lib\rrd.php.. And is it enough only changing rrd path? Is there any changes in database tables?
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: Aggregate Plugin graph item limit problem

Post by gandalf »

I fear that it is not a good idea to head into this if you can't figure out those questions.
Yes, this is kind of a hard word, but again, please know that we are NOT supporting this. So there might be a lot of places in the code that are affected. So all code changes are done on your risk. Helping you more would move those risks over to me.
R.
cigamit
Developer
Posts: 3367
Joined: Thu Apr 07, 2005 3:29 pm
Location: B/CS Texas
Contact:

Re: Aggregate Plugin graph item limit problem

Post by cigamit »

Why not change it in global.php

Code: Select all

$config["rra_path"] = $config["base_path"] . '/rra';
It is not going to work for your current ones (they are saved in the DB with the old paths) but future ones will be placed there.
mskaralar
Posts: 10
Joined: Fri Sep 17, 2010 6:55 am
Location: Turkey

Re: Aggregate Plugin graph item limit problem

Post by mskaralar »

Thank you for your answers Gandalf, Cigamit. I gave up changing rrd path because of another problems..
After a month, I noticed someting about my problem. As ı explaned before, "while ı am trying to aggregate graph items more then 65, my graph doesnt seem (when ı add the 66th graph item!) When ı removed graph item66, my graph returns and ı can see."

And ı could not see any logs about this case, now I find a log in C:\Apache2\logs\error.logs.
Log description:
"The command line is too long."

As soon as ı try aggregating more then 65 graph items, this log occurs. I have search about this log and limitations of apache, I find "LimitRequestLine 81900" "LimitRequestBody 2147483646" in http://httpd.apache.org/docs/2.0/en/mod ... lrecursion, I increased this limitations and write in httpd.conf. But my problem goes on.

Maybe this is the log you said me before, windows command line limitation, I dont know. Now, my question, is there a limitation in apache about my case and how can ı resolve this error log?
Thank you.
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: Aggregate Plugin graph item limit problem

Post by gandalf »

I suppose that windows command line only allows up to 2k (I've read it somewhere). But don't trust me; I'm no windows guy.
For apache related questions, please post to their forums.
R.
goldan13
Posts: 1
Joined: Tue Jun 14, 2022 3:21 pm

Re: Aggregate Plugin graph item limit problem

Post by goldan13 »

I have the same problem with the version cacti Version 0.8.8h in a graph of 711 Items, I add one more item and the graph disappears, could someone help me with the solution please? //sorry for my english
Post Reply

Who is online

Users browsing this forum: No registered users and 1 guest