Submit Your CMD.PHP vs. SPINE Metrics Here

Important information about Cacti developments that all users should be interested in.

Moderators: Developers, Moderators

Post Reply
Exo7
Cacti User
Posts: 136
Joined: Wed Jul 13, 2005 4:50 pm

Post by Exo7 »

System data :
Type : Dell PowerEdge 1950
CPU : Intel Xeon Dual Core 3.2Ghz, with Hyperthreading enabled
Memory : 2Gb
Disk : 2*136Go Raid 1 SAS
OS : Linux 2.6.17-2-686 (Debian Etch)
Create 10 rrds 3 c/s (0.00147 sdv) Update 10 rrds 15757 u/s (0.00006 sdv)
Create 10 rrds 3 c/s (0.00149 sdv) Update 20 rrds 15742 u/s (0.00009 sdv)
Create 20 rrds 3 c/s (0.00300 sdv) Update 40 rrds 15899 u/s (0.00001 sdv)
Create 40 rrds 2 c/s (0.00598 sdv) Update 80 rrds 15863 u/s (0.00005 sdv)
Create 80 rrds 2 c/s (0.01197 sdv) Update 160 rrds 14628 u/s (0.00065 sdv)
Create 160 rrds 2 c/s (0.02655 sdv) Update 320 rrds 14465 u/s (0.00080 sdv)
Create 320 rrds 1 c/s (0.04783 sdv) Update 640 rrds 12359 u/s (0.00189 sdv)
Create 640 rrds 1 c/s (0.30954 sdv) Update 1280 rrds 9321 u/s (0.00304 sdv)
Create 1280 rrds 1 c/s (0.25520 sdv) Update 2560 rrds 3137 u/s (0.01608 sdv)
Create 768 rrds 2 c/s (0.23385 sdv) Update 3328 rrds 1142 u/s (0.01343 sdv)
I have not successfully run the script under Debian Sarge / PowerEdge 1850. It dies when calling RRDs::update (rddtool 1.0.49 installed)

"Create 10 rrds 2 c/s (0.01714 sdv)conversion of '1162305542.4178' to long not complete: tail '.4178' at perftest.pl line 58.
"
Top
knobdy
Cacti User
Posts: 495
Joined: Wed Sep 28, 2005 1:39 pm

Post by knobdy »

YAY - IT WORKS!

So, I'm using cacti and cactid 8.6i and it SCREAMS:

11/06/2006 10:00:45 AM - SYSTEM STATS: Time:43.5471 Method:cactid Processes:3 Threads:20 Hosts:87 HostsPerProcess:29 DataSources:7328 RRDsProcessed:3304

That's 3 minutes quicker than cmd.php!

The system:
SuSE 10.0
IBM P710
4G RAM
Hostinfo:
Cacti Version - 0.8.6i
Plugin Architecture - 1.0
Poller Type - Cactid v0.8.6i
Server Info - Linux 2.6.13-15.7-ppc64
Web Server - Apache/2.0.54 (Linux/SUSE)
PHP - 5.0.4
PHP Extensions - xml, standard, SPL, SimpleXML, session, pcre, libxml, apache2handler, bz2, gd, iconv, mcrypt, mysql, mysqli, snmp, zlib
MySQL - 4.1.13-Max
RRDTool - 1.2.11
SNMP - 5.2.1
Plugins
  • RRD Cleaner - v1.1
    FlowView (flowview - v0.3)
    Change password (passwd - v0.1)
    Poller Performance Report (pollperf - v0.1)
    Update Checker (update - v0.3)
    Host Info (hostinfo - v0.1)
    PHP Network Weathermap (weathermap - v0.82)
    thold - v0.2.7
    Device Tracking (mactrack - v0.0.1b)
    links - v0.7
Just have to work on getting the PIX to graph again...(they stopped with the cactid upgrade)


perftest:

Code: Select all

Create     10 rrds      1 c/s (0.00207 sdv)   Update     10 rrds   12662 u/s (0.00001 sdv)
Create     10 rrds      1 c/s (0.00214 sdv)   Update     20 rrds   12689 u/s (0.00003 sdv)
Create     20 rrds      1 c/s (0.00422 sdv)   Update     40 rrds   12671 u/s (0.00001 sdv)
Create     40 rrds      1 c/s (0.00841 sdv)   Update     80 rrds   12647 u/s (0.00003 sdv)
Create     80 rrds      1 c/s (0.01721 sdv)   Update    160 rrds   12470 u/s (0.00004 sdv)
Create    160 rrds      1 c/s (0.38558 sdv)   Update    320 rrds   12200 u/s (0.00005 sdv)
Create    320 rrds      6 c/s (0.06830 sdv)   Update    640 rrds   11601 u/s (0.00008 sdv)
Create    640 rrds      1 c/s (0.13650 sdv)   Update   1280 rrds   10660 u/s (0.00011 sdv)
Create   1280 rrds      2 c/s (0.28660 sdv)   Update   2560 rrds    8602 u/s (0.00036 sdv)
Create   2560 rrds      2 c/s (0.27584 sdv)   Update   5120 rrds    5386 u/s (0.00029 sdv)
Create   5120 rrds      2 c/s (0.28877 sdv)   Update  10240 rrds    1718 u/s (0.00047 sdv)
Create   3072 rrds      1 c/s (0.29052 sdv)   Update  13312 rrds    4890 u/s (0.00031 sdv)

* Stopping test since your system seems to have hit the cache barrier.
Top
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:
Contact gandalf

Post by gandalf »

Please remember: /full/path/to/perl .... And afterwards "php rebuild_poller_chache.php" ...
Good luck
Reinhard
Top
mirassou
Posts: 4
Joined: Fri Mar 05, 2004 10:42 am

Post by mirassou »

Hi

Method: cactid 0.8.6.g.

11/20/2006 11:52:48 AM - SYSTEM STATS: Time:167.4736 Method:cactid Processes:1 Threads:1 Hosts:206 HostsPerProcess:206 DataSources:45631 RRDsProcessed:16906

Hosts polled: 206
Average time to poll : 168 seconds
Concurrrent processes : 1
Thread : 1
Processor speed : 3 GHz
Number of processors : 2
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Boost is still going through internal testing. It is now at RC-2. For those that have requested to Beta and have, to date, not been responded to, I will send out mailings this evening.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
project_jupiter
Posts: 6
Joined: Fri Nov 17, 2006 12:46 pm

Post by project_jupiter »

Code: Select all

11/21/2006 11:41:49 AM - SYSTEM STATS: Time:108.3393 Method:cmd.php Processes:2 Threads:N/A Hosts:71 HostsPerProcess:36 DataSources:1268 RRDsProcessed:875

11/21/2006 11:36:01 AM - SYSTEM STATS: Time:60.1384 Method:cmd.php Processes:2 Threads:N/A Hosts:71 HostsPerProcess:36 DataSources:1268 RRDsProcessed:875

11/21/2006 11:31:29 AM - SYSTEM STATS: Time:88.3090 Method:cmd.php Processes:2 Threads:N/A Hosts:71 HostsPerProcess:36 DataSources:1268 RRDsProcessed:875

11/21/2006 11:26:19 AM - SYSTEM STATS: Time:78.2544 Method:cmd.php Processes:2 Threads:N/A Hosts:71 HostsPerProcess:36 DataSources:1268 RRDsProcessed:875

System stats:
- cacti 0.8.6i with updates, running thold, monitor, syslog plugins
- FC4 with latest updates only slightly tuned for performance
- mysql 4.1.20 (tuned, not out of the box)
- php 5

Machine stats:
- Desktop Dell Dimention 3000
- 2.8 P4 Single Core CPU
- 512MB (according to top only approximately 220Mb used)
- some el-cheapo 80Gb IDE Drive.

Dual Core or Multi-threaded machine seems to give significant improvement in php running time. Dual CPU would probably be even faster.

MySQL tuning seems to give significant boost in performance.


Regards,
Top
User avatar
fmangeant
Cacti Guru User
Posts: 2345
Joined: Fri Sep 19, 2003 8:36 am
Location: Sophia-Antipolis, France
Contact:
Contact fmangeant

Post by fmangeant »

I've finally upgraded cactid from 0.8.6d to 0.8.6i on my Cacti server #1 (couldn't do it before because of some crappy NRPE scripts we were using, and :o
  • before
    11/28/2006 09:54:30 AM - SYSTEM STATS: Time:268.9168 Method:cactid Processes:7 Threads:17 Hosts:650 HostsPerProcess:93 DataSources:14294 RRDsProcessed:10424
    11/28/2006 09:54:31 AM - RECACHE STATS: RecacheTime:0.3909 HostsRecached:1
    11/28/2006 09:56:17 AM - EXPORT STATS: ExportDate:2006-11-28_9:56:17 ExportDuration:106.6311 TotalGraphsExported:324
  • after
    11/28/2006 10:46:59 AM - SYSTEM STATS: Time:117.1721 Method:cactid Processes:7 Threads:17 Hosts:640 HostsPerProcess:92 DataSources:14199 RRDsProcessed:10193
    11/28/2006 10:46:59 AM - RECACHE STATS: RecacheTime:0.0337 HostsRecached:1
    11/28/2006 10:47:53 AM - EXPORT STATS: ExportDate:2006-11-28_10:47:53 ExportDuration:53.3204 TotalGraphsExported:324
[size=84]
[color=green]HOWTOs[/color] :
[list][*][url=http://forums.cacti.net/viewtopic.php?t=15353]Install and configure the Net-SNMP agent for Unix[/url]
[*][url=http://forums.cacti.net/viewtopic.php?t=26151]Install and configure the Net-SNMP agent for Windows[/url]
[*][url=http://forums.cacti.net/viewtopic.php?t=28175]Graph multiple servers using an SNMP proxy[/url][/list]
[color=green]Templates[/color] :
[list][*][url=http://forums.cacti.net/viewtopic.php?t=15412]Multiple CPU usage for Linux[/url]
[*][url=http://forums.cacti.net/viewtopic.php?p=125152]Memory & swap usage for Unix[/url][/list][/size]
Top
User avatar
Instigater
Cacti User
Posts: 141
Joined: Mon Dec 13, 2004 5:14 pm
Location: Jurmala, Latvia

Post by Instigater »

P4 Xeon 3.0Ghz 533Mhz FSB
8Gig RAM
2x76Gb SCSI RAID0

1 minute polling resolution, 5.5 Gig RRD files.

Code: Select all

01/02/2007 01:53:31 PM - SYSTEM STATS: Time:29.8634 Method:cactid Processes:4 Threads:8 Hosts:131 HostsPerProcess:33 DataSources:4789 RRDsProcessed:2249
Top
kanada
Cacti User
Posts: 137
Joined: Sun Aug 28, 2005 12:51 pm

Post by kanada »

Cacti 0.8.6h
CACTID 0.8.6i Copyright 2002-2006 by The Cacti Group
CPU: 2xPIV Intel(R) Xeon(TM) CPU 3.00GHz
Memory: 4GB DDR ECC
HDD: 2xSCSII 15000 obr/min.
OS: Linux, Apache 2.0.54, PHP 5.0.4 (cli), Mysql 4.1.12

Cacti settings:
Poller Type Cactid
Maximum Concurrent Poller Processes: 6
Maximum Threads per Process: 100
Number of PHP Script Servers: 8
Script and Script Server Timeout Value: 5
The Maximum SNMP OID's Per SNMP Get Request: 40

MySql settings:
key_buffer = 768M
max_connections = 4000
thread_concurrency = 4


01/19/2007 11:35:38 AM - SYSTEM STATS: Time:338.2336 Method:cactid Processes:6 Threads:100 Hosts:6270 HostsPerProcess:1045 DataSources:35153 RRDsProcessed:18756
01/19/2007 11:45:39 AM - SYSTEM STATS: Time:338.5238 Method:cactid Processes:6 Threads:100 Hosts:6270 HostsPerProcess:1045 DataSources:35153 RRDsProcessed:18302

I still try minimalize operation time, in this time i have set 10 min. cycle request.

Any good ideas will be welcome ;)
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Boost. Either on your own or via contract. It's not 100% yet, but it works where I have it deployed. However, others have reported issues.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
slammine
Posts: 1
Joined: Tue Jan 23, 2007 2:48 am

Post by slammine »

cacti 0.8.6i
2x P4 Intel XEON 3.2GHz
Memory 2GB
OS: Linux, Debian

cactid.php

Time:15.8389
Processes:5
Threads:10
Hosts:144
HostsPerProcess:29
DataSources:11422
RRDsProcessed:5697

cmd.php
Time:30.2353
Processes:5
Threads:N/A
Hosts:144
HostsPerProcess:29
DataSources:11422
RRDsProcessed:5697

~
Top
eric.kim
Posts: 1
Joined: Mon Mar 20, 2006 7:53 am
Location: Seoul, Korea

Post by eric.kim »

cacti 0.8.6i
DELL PowerEdge 2950
CPU: Dual Core Xeon Pro 5160(woodcrest) * 2EA
Memory: 4GB
Disk: OS: 36GB(RAID1), Data: 146GB(RAID1)
OS: CentOS 4.4(x64)

02/05/2007 10:40:15 PM - SYSTEM STATS: Time:13.7070 Method:cactid Processes:1 Threads:10 Hosts:144 HostsPerProcess:144 DataSources:23511 RRDsProcessed:9992
02/05/2007 10:45:15 PM - SYSTEM STATS: Time:13.6400 Method:cactid Processes:1 Threads:10 Hosts:144 HostsPerProcess:144 DataSources:23511 RRDsProcessed:9992
02/05/2007 10:50:15 PM - SYSTEM STATS: Time:14.8098 Method:cactid Processes:1 Threads:10 Hosts:144 HostsPerProcess:144 DataSources:23511 RRDsProcessed:9992
02/05/2007 10:55:15 PM - SYSTEM STATS: Time:13.7270 Method:cactid Processes:1 Threads:10 Hosts:144 HostsPerProcess:144 DataSources:23511 RRDsProcessed:9992

At this time, the graph menu show image with delay.(1~10 seconds)
My team mate complain to me that web is too slow to watch...:(

So, I consider upgrading memory(to 12GB) or finding bug of apache or MySQL. Because memory resource has no non-using space.
OS: CentOS 4.5 x86_64 (final)| Cacti-0.8.6j, Cactid-0.8.6i |144 devices| 23511 Datasources
- DELL PowerEdge 2950
Xeon 5160 Dual, 4GB memory, 146GB (RAID 1)
Top
Exo7
Cacti User
Posts: 136
Joined: Wed Jul 13, 2005 4:50 pm

Post by Exo7 »

Cacti web performance is affected by how many graphs per page you have to display. Apache requests all the image at once, so if you have 100 graphs on a host it will take a bit longer than 10 to process.
If you have a lot of graph based on the same template, you can try to switch graph grouping style to "data query index" to see if there is an improvement.
You can also try to expand host in order to have one more level of depth in your tree.
Top
cwalton
Posts: 15
Joined: Wed May 10, 2006 7:53 am

Post by cwalton »

I just modified my test Cacti system to poll with cactid.

System Specs:
Dual 1.3GHz PIII
3.5GB RAM
Windows Server 2003 Enterprise

Cacti Specs:
0.8.6j
Using plugin architecture
Plugins: thold, monitor, weathermap

This machine runs 4 separate cacti sites (5m poll, 1m poll, 30s poll, 10s poll) as well as GLPI, and hosts the databases for each.

CMD.PHP
02/06/2007 09:05:26 AM - SYSTEM STATS: Time:25.5670 Method:cmd.php Processes:4 Threads:N/A Hosts:28 HostsPerProcess:7 DataSources:532 RRDsProcessed:330

CACTID
02/06/2007 09:33:24 AM - SYSTEM STATS: Time:17.5608 Method:cactid Processes:2 Threads:6 Hosts:28 HostsPerProcess:14 DataSources:532 RRDsProcessed:330


I've played around with the # of procs/threads, and this seemed optimal for my setup. A savings of 8 seconds is significant when running multiple concurrent pollers, and thus makes me happy :)


Thanks, cacti!
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Cwalton,

Check out the Boost plugin. Should make you very happy indeed.

TheWitness

http://forums.cacti.net/viewtopic.php?t=18430
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
Post Reply

Return to “Announcements”

Who is online

Users browsing this forum: No registered users and 0 guests