problem performance

StaWha · Post by **StaWha** » Wed Aug 31, 2005 11:02 am

I run cacti 0.8.6f, rrdtool 1.2.11, cactid 086e on a dual xeon 1.3GHz 1GB of RAM.The raid is raid 5 with 5 scsi disks. Os is RHEL 4.0.
In debug mode, i have:

08/31/2005 05:28:59 PM - SYSTEM STATS: Time: 236.1546 s, Method: cactid, Processes: 1, Threads: 30, Hosts: 160, Hosts/Process: 160, Data Sources 23333, RRDs Processed 11971
the rrdtool update commands
08/31/2005 05:25:39 PM - CACTID: Poller[0] Time: 35.6157 s, Threads: 30, Hosts: 160

Total polling time: 236s
Rrdtool update time: 200s
Cactid poller time: 36s

Is it normal rrdtool update takes such long period?
Thanks.

Post by **rony** » Wed Aug 31, 2005 11:04 am

Yes and no.... But the updates are all bound by the speed of your disk I/O.

Maybe your raid is running in degrated mode?

StaWha · Post by **StaWha** » Wed Aug 31, 2005 11:17 am

The raid isn't in degraded mode.
There isn't a possibility to decrease this period?
Thanks.

Post by **TheWitness** » Wed Aug 31, 2005 11:25 am

What are your current I/O rates to your disk during RRD updates? Please state in Mbytes/sec. My 10k Raid-1 SCSI (40Mbytes/sec channel) drives update about 5400 RRD files in less than 50 seconds.

TheWitness

Post by **TheWitness** » Wed Aug 31, 2005 11:27 am

BTB, I do have a patch designed for 0.9 that you may test. Unfortunately, having now noted the number of RRD files you are dealing with (> 10k), it may likely not have an effect noting the number of RRD files you are dealing with.

Please let me know if you are interested.

TheWitness

StaWha · Post by **StaWha** » Wed Aug 31, 2005 11:28 am

How can i know this rate?

StaWha · Post by **StaWha** » Wed Aug 31, 2005 11:33 am

How can i know this rate?

Post by **TheWitness** » Wed Aug 31, 2005 11:38 am

Not too sure with RedHat. Maybe rony can advise? Also, with Raid-5, you should be completing much quicker than I. Do you have disk caching disabled? Also, what are the file sizes of your RRD files? What version of RRDtool are you using?

TheWitness

StaWha · Post by **StaWha** » Wed Aug 31, 2005 11:46 am

I use rrdtool 1.2.11.
Caching disk is enabled.
I have 4000 rrds of 275ko and 8000 of 70ko.

Post by **TheWitness** » Wed Aug 31, 2005 11:47 am

Very odd, what version of RRDtool where the RRD files created in?

Larry

StaWha · Post by **StaWha** » Wed Aug 31, 2005 11:51 am

The rrd files were created whith the same version.
Thanks.

StaWha · Post by **StaWha** » Wed Aug 31, 2005 12:04 pm

I will probably tempt to reduce my number of rrd files.
Thanks for your replies Tony and Larry.

PW · Post by PW » Wed Sep 07, 2005 7:50 am

Hi!

I have a simular problem, my setup is:

Intel 3.4Gz XEON 4GB Ram White Box Enterprise Linux release 4
Raid 0, running cacti 0.8.6f, rrdtool-1.2.11 and cactid

SYSTEM STATS: Time: 237.7790 s, Method: cactid, Processes: 8, Threads: 45, Hosts: 196, Hosts/Process: 25, Data Sources 17119, RRDs Processed 6577

The total RRA dir is 9.4 GB

Is there something wrong? I tried to change threads/processes with no luck.

Please advice.

StaWha · Post by **StaWha** » Fri Sep 09, 2005 5:57 am

I have lightly decrease my total poller time by reduce the number of thread. Cactid poller time is increase but rrdtool update are now made
less frequent.
I reduce thread to 8 and I have win 30 secondes on total poller time.
May be you can try this PW.

Post by **rony** » Fri Sep 09, 2005 9:06 am

How many Data Sources do you have?

Maybe a adjusting you mysql server settings, especially for table cache size, might help.

Cacti

problem performance

problem performance

Poller time.

Who is online