Submit Your CMD.PHP vs. SPINE Metrics Here

Important information about Cacti developments that all users should be interested in.

Moderators: Developers, Moderators

Post Reply
Oldie
Posts: 4
Joined: Tue Aug 23, 2005 7:57 am
Location: Xanten, Germany

Post by Oldie »

An excellent tool ! It was decided to use Cacti as a replacement for a commercial tool in our company.

We are running Cacti as follows :

Database/polling server

2 x 2.7GHz Xeon,
Suse Linux 8.2 under VM/ESX server,
4GB RAM ( usable : 3.6GB )
Disks 1x18GB, 1x36GB
IHS Webserver 2.0.42.1 ( IBM, based on Apache )
RRDTool 1.0.49
MySQL 4.0.24
PHP 4.3.8
Cacti 0.8.6g
Cactid 0.8.6f

This server is running MySQL, RRDTool, and polling. Administration & presentation access ( for "normal" user - approx. 200 registered ) is realized through separate servers, connected via a shared WAN link 120 Mbit/s

MySQL tuning :
key_buffer = 32M
max_allowed_packet = 1M
table_cache = 64
sort_buffer_size = 512K
net_buffer_length = 8K
myisam_sort_buffer_size = 8M
max_connections = 4000
query_cache_size=64M

Presentation server

1 x 1.7GHz Xeon,
Suse Linux 8.2 under VM/ESX server,
1GB RAM
IHS Webserver 2.0.42.1 ( IBM, based on Apache )
MySQL 4.0.24, connected to the Database/polling server
PHP 4.3.8
Cacti 0.8.6g
RRDTool is connected via NFS mount


Administration server

1 x 2.8GHz P4
Suse Linux 8.2
1GB RAM
IHS Webserver 2.0.42.1 ( IBM, based on Apache )
MySQL 4.0.24, connected to the Database/polling server
PHP 4.3.8
Cacti 0.8.6g
RRDTool is connected via NFS mount

Polling statistics ( 1 extract )

12/15/2005 02:22:38 PM - SYSTEM STATS: Time:157.5933 Method:cactid Processes:6 Threads:30 Hosts:1479 HostsPerProcess:247 DataSources:46797 RRDsProcessed:23972

The network devices are located all around the world, connected through WAN links with 2 - 155 Mbit/s. The devices are mainly layer 3 router, currently only traffic I/O and CPU usage is monitored. Long term it is intended to include all our layer 2 devices as well but that will most probably require the distributed polling support promised for Cacti 0.9x .

On the presentation server we have linked - into Cacti as a separate tab - the Network Weathermap ( Howie 's php-weathermap-0.6 ) for the global core links.

Please, don't ask for which company we are working - its a big global player, that's all we are allowed to say.

Problems so far
  • the presentation of data / charts is a bit slow - we need better hardware for the presentation and a faster link to the database / polling server. We will also try to improve the performance by separating database & polling on different servers with a 1 Gbit/s connection ( at least ) together with improved hardware ( more CPU's & more RAM ).
Feature requests
  • we are missing some sort functions in the tables for devices & user management
  • users would like to customize the time zone to view the results ( data collection is based on GMT/UTC of course )
For any questions contact either myself ( Oldie ) or Frizz.
The Oldie
Top
User avatar
fmangeant
Cacti Guru User
Posts: 2345
Joined: Fri Sep 19, 2003 8:36 am
Location: Sophia-Antipolis, France
Contact:
Contact fmangeant

Post by fmangeant »

Hi Oldie

did you use MySQL replication between your database and presentation server ?
[size=84]
[color=green]HOWTOs[/color] :
[list][*][url=http://forums.cacti.net/viewtopic.php?t=15353]Install and configure the Net-SNMP agent for Unix[/url]
[*][url=http://forums.cacti.net/viewtopic.php?t=26151]Install and configure the Net-SNMP agent for Windows[/url]
[*][url=http://forums.cacti.net/viewtopic.php?t=28175]Graph multiple servers using an SNMP proxy[/url][/list]
[color=green]Templates[/color] :
[list][*][url=http://forums.cacti.net/viewtopic.php?t=15412]Multiple CPU usage for Linux[/url]
[*][url=http://forums.cacti.net/viewtopic.php?p=125152]Memory & swap usage for Unix[/url][/list][/size]
Top
Frizz
Cacti User
Posts: 80
Joined: Sat Mar 05, 2005 5:07 pm
Location: Herne Germany

Post by Frizz »

fmangeant wrote:Hi Oldie

did you use MySQL replication between your database and presentation server ?
Fmangeant,
no, only with directed SQL requests via TCP.
We´re using a single database without replication.
Do you have operating experience with a replicated database and Cacti?
Frizz (the colleague of Oldie)
Top
saruter
Posts: 2
Joined: Thu Dec 15, 2005 5:18 am

Here are my statistics for Cactid 0.8.6-f1

Post by saruter »

Hosts Polled: 32
Average Time to Poll: 47 seconds
Concurrent Processes: 1
Threads: 2
RRDs to process: 1576
DS: 3158
Host: 500 MHz Pentium 3 - 192 MB RAM
Number of Processors: 1
Top
kayalinux
Posts: 23
Joined: Mon Oct 31, 2005 4:38 am

Post by kayalinux »

SYSTEM STATS: Time:77.7993 Method:cmd.php Processes:3 Threads:N/A Hosts:106 HostsPerProcess:36 DataSources:1464 RRDsProcessed:932
SYSTEM STATS: Time:72.7385 Method:cmd.php Processes:3 Threads:N/A Hosts:106 HostsPerProcess:36 DataSources:1464 RRDsProcessed:912
SYSTEM STATS: Time:67.7246 Method:cmd.php Processes:3 Threads:N/A Hosts:106 HostsPerProcess:36 DataSources:1464 RRDsProcessed:907
SYSTEM STATS: Time:73.7399 Method:cmd.php Processes:3 Threads:N/A Hosts:106 HostsPerProcess:36 DataSources:1464 RRDsProcessed:922


SYSTEM STATS: Time:16.0501 Method:cactid Processes:3 Threads:3 Hosts:106 HostsPerProcess:36 DataSources:1464 RRDsProcessed:1946
SYSTEM STATS: Time:14.5502 Method:cactid Processes:3 Threads:3 Hosts:106 HostsPerProcess:36 DataSources:1464 RRDsProcessed:973
SYSTEM STATS: Time:14.5466 Method:cactid Processes:3 Threads:3 Hosts:106 HostsPerProcess:36 DataSources:1464 RRDsProcessed:973
SYSTEM STATS: Time:15.5630 Method:cactid Processes:3 Threads:3 Hosts:106 HostsPerProcess:36 DataSources:1464 RRDsProcessed:973


When run by hand, dorectly on the console.
CACTID: Execution Time: 36.6520 s, Threads: 3, Hosts: 106


Linux RedHat EL 4

Bi Intel(R) Xeon(TM) CPU 3.00GHz
MemTotal: 2074964 kB

Apache/2.0.52
RRDtool 1.0.50
Mysql 4.1.12
PHP 4.3.9
Cacti 0.8.6g
CACTID 0.8.6e
Top
User avatar
ehelm
Posts: 16
Joined: Tue Dec 20, 2005 9:45 pm

CACTID 0.8.6e

Post by ehelm »

12/20/2005 08:40:28 PM - SYSTEM STATS: Time:27.5478 Method:cactid Processes:1 Threads:20 Hosts:374 HostsPerProcess:374 DataSources:3619 RRDsProcessed:2158

Fedora Core4
Cacti 0.8.6g
Cactid 0.8.6e
RRDtool 1.2.11
Apache 2.0.54
MySQL 4.1.14
PHP 4.4.0
Dual Xeon 3Ghz
4GB RAM
Top
thomasw
Posts: 33
Joined: Thu Nov 10, 2005 6:11 am

cactid poller stats

Post by thomasw »

Great peace of work!

Here our experience about cacti-scaling

2 x fsc-blade servers ( 1 LAN / 1 WAN) running cacti on the following hardware:

-dual xeon 3,2 ghz (hyperthreading)
- 4 GB RAM
- 36 GB SCSI RAID-1 U-320

- 2x1000 NIC (1xpoller,1xweb)

Debian Linux 3.1 with Kernel 2.6.14.3 as OS

The poller statistics from the LAN Manager (using 1,1GB RAM):
12/22/2005 10:35:11 AM - SYSTEM STATS: Time:9.3620 Method:cactid Processes:4 Threads:8 Hosts:55 HostsPerProcess:14 DataSources:11774 RRDsProcessed:5887
12/22/2005 10:30:10 AM - SYSTEM STATS: Time:8.3489 Method:cactid Processes:4 Threads:8 Hosts:55 HostsPerProcess:14 DataSources:11774 RRDsProcessed:5887


The poller statistics from the WAN manager (using 1,8GB RAM):
12/22/2005 11:00:46 AM - SYSTEM STATS: Time:45.1819 Method:cactid Processes:4 Threads:16 Hosts:757 HostsPerProcess:190 DataSources:5019 RRDsProcessed:2491
12/22/2005 10:55:44 AM - SYSTEM STATS: Time:42.2030 Method:cactid Processes:4 Threads:16 Hosts:757 HostsPerProcess:190 DataSources:5019 RRDsProcessed:2491

I`m very impressed about the poller runtime, really a great peace of work!!

Hope somebody can use the informations on scaling his cacti installation...
Top
Mikkel
Posts: 32
Joined: Thu May 12, 2005 12:41 am

Post by Mikkel »

Windows 2003 Standard Edition SP 1
Dual Xeon 3,2 GHz with HT.
2 GB RAM
2 x 36 GB SCSI U320
1000 Mb LAN

Cacti 0.8.6g with Cactid 0.8.6f-1
Devices: All Cisco.
Switches 29xx, 35xx, 37xx, 4006, 450x, 6509.
Routers 26xx, 36xx, 37xx, 720x, 750x, 6509 (sup720).

SYSTEM STATS: Time:69.2864 Method:cactid Processes:4 Threads:16 Hosts:103 HostsPerProcess:26 DataSources:60259 RRDsProcessed:14509
Top
rking
Posts: 4
Joined: Mon Jan 09, 2006 10:03 am

Post by rking »

Linux (hostname removed) 2.4.22-1.2188.nptl #1 Wed Apr 21 20:36:05 EDT 2004 i686 i686 i386 GNU/Linux
CPU: Pentium 4 2.80GHz
Memory: 1GB

cmd.php:

01/09/2006 09:34:26 AM - SYSTEM STATS: Time:265.3257 Method:cmd.php Processes:1 Threads:N/A Hosts:92 HostsPerProcess:92 DataSources:1872 RRDsProcessed:2592

cactid 1 thread:

01/09/2006 09:58:28 AM - SYSTEM STATS: Time:106.5779 Method:cactid Processes:1 Threads:1 Hosts:92 HostsPerProcess:92 DataSources:1872 RRDsProcessed:2505

cactid 5 threads:

01/09/2006 10:00:14 AM - SYSTEM STATS: Time:13.9974 Method:cactid Processes:1 Threads:5 Hosts:92 HostsPerProcess:92 DataSources:1872 RRDsProcessed:1972
Top
pyoung
Posts: 13
Joined: Mon Nov 07, 2005 2:51 pm

Post by pyoung »

Hosts Polled: 202
Average Time to Poll: 12 seconds
Concurrent Processes: 2
Threads: 32
RRDs to process: 3844
DS: 5835
Host: IBM x345 running Debian 3.1 (hand-compiled apache/php) 2gb RAM.
Number of Processors: 2 (HT on)
Top
krzn
Posts: 3
Joined: Wed Nov 23, 2005 9:33 am
Location: Moers, Germany

cactid

Post by krzn »

02/21/2006 11:35:22 AM - SYSTEM STATS: Time:20.4091 Method:cactid Processes:5 Threads:10 Hosts:239 HostsPerProcess:48 DataSources:3421 RRDsProcessed:3035

SLES 9 machine as a guest on VMware ESX Server with 2 virtual CPUs and 512 MB RAM.

Load average: 0.12, 0.23, 0.32

mfG
krzn
Top
argon0
Cacti User
Posts: 460
Joined: Fri Mar 12, 2004 1:22 pm

Post by argon0 »

<erm> I get this:

02/22/2006 02:05:00 PM - CACTID: Poller[0] Time: 295.1461 s, Threads: 100, Hosts: 17
02/22/2006 02:05:00 PM - THOLD: Poller[0] Checking Thresholds
02/22/2006 02:04:59 PM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
02/22/2006 02:04:57 PM - CACTID: Poller[0] Host[5] DS[123] SERVER: /var/www/html/scripts/ss_host_cpu.php ss_host_cpu 10.96.11.16 5 2:161:500:crystal:::MD5::[None] get usage 3, output: 2
02/22/2006 02:04:57 PM - SYSTEM STATS: Time:293.2949 Method:cactid Processes:2 Threads:150 Hosts:34 HostsPerProcess:17 DataSources:637 RRDsProcessed:366
02/22/2006 02:04:57 PM - POLLER: Poller[0] Maximum runtime of 292 seconds exceeded. Exiting.

Heyalp!

Specs of system:

Dell Optiplex GX280, 512Mb Ram, 2.4Ghx processor, enough disk space, but only a desktop PC...
No longer a n00by, probably, by now an 0ldby

Now Head of Technology at RSCH, back to the prickly subject of Monitorring....
Top
bakulev
Posts: 1
Joined: Tue Feb 28, 2006 5:39 am
Contact:
Contact bakulev

My stats

Post by bakulev »

02/28/2006 07:50:30 AM - SYSTEM STATS: Time: 28.6705 s, Method: cactid, Processes: 1, Threads: 20, Hosts: 209, Hosts/Process: 209
Average time: 39,23 s

Hosts Polled: 209
Average Time to Poll: 0,65 Minutes
Concurrent Processes: 1
Threads: 20
Processor Speed: 1400 Mhz
Number of Processors: 2
Top
User avatar
Howie
Cacti Guru User
Posts: 5508
Joined: Thu Sep 16, 2004 5:53 am
Location: United Kingdom
Contact:
Contact Howie

Post by Howie »

Before:
03/07/2006 04:52:51 PM - SYSTEM STATS: Time:170.4900 Method:cmd.php Processes:4 Threads:N/A Hosts:78 HostsPerProcess:20 DataSources:1663 RRDsProcessed:964

After:
03/07/2006 05:05:23 PM - SYSTEM STATS: Time:23.2880 Method:cactid Processes:4 Threads:1 Hosts:78 HostsPerProcess:20 DataSources:1663 RRDsProcessed:962

8x improvement. Very impressive!

Server is a basic PIII-1Ghz with 512Mb. It's also running our (fairly busy) Request Tracker installation at the moment.
Weathermap 0.98a is out! & QuickTree 1.0. Superlinks is over there now (and built-in to Cacti 1.x).
Some Other Cacti tweaks, including strip-graphs, icons and snmp/netflow stuff.
(Let me know if you have UK DevOps or Network Ops opportunities, too!)
Top
User avatar
N3NCY
Cacti User
Posts: 260
Joined: Thu Sep 22, 2005 7:50 pm
Location: Landenberg, PA
Contact:
Contact N3NCY

Post by N3NCY »

The biggest speed boost I got was going from RRDTool 1.0.49 to 1.2.12
(aside from switching from CMD.php to Cactid)

My production server:
FreeBSD v5.4 on a Pentium 4 3.0Ghz 1Gb RAM (Soft mirrored 160GB HD)
PHP v5.0.5
Apache v2.0.55
MySQL v4.14
Net-SNMP v5.3.0.1
Cacti v0.8.6h
Cactid v0.8.6g
Addons: Plugin Architecture, Discovery, Thresholds, Monitor, nTop

03/10/2006 10:33:59 PM - THOLD: Poller[0] Checking Thresholds
03/10/2006 10:33:56 PM - SYSTEM STATS: Time:235.6594 Method:cactid Processes:4 Threads:50 Hosts:184 HostsPerProcess:46 DataSources:19728 RRDsProcessed:7634
03/10/2006 10:28:31 PM - THOLD: Poller[0] Checking Thresholds
03/10/2006 10:28:29 PM - SYSTEM STATS: Time:208.7758 Method:cactid Processes:4 Threads:50 Hosts:184 HostsPerProcess:46 DataSources:19728 RRDsProcessed:7634
03/10/2006 10:23:34 PM - THOLD: Poller[0] Checking Thresholds
03/10/2006 10:23:31 PM - SYSTEM STATS: Time:210.9291 Method:cactid Processes:4 Threads:50 Hosts:184 HostsPerProcess:46 DataSources:19728 RRDsProcessed:7634
03/10/2006 10:18:44 PM - THOLD: Poller[0] Checking Thresholds
03/10/2006 10:18:41 PM - SYSTEM STATS: Time:220.2290 Method:cactid Processes:4 Threads:50 Hosts:184 HostsPerProcess:46 DataSources:19728 RRDsProcessed:7634
03/10/2006 10:13:28 PM - THOLD: Poller[0] Checking Thresholds
03/10/2006 10:13:22 PM - SYSTEM STATS: Time:201.7582 Method:cactid Processes:4 Threads:50 Hosts:184 HostsPerProcess:46 DataSources:19728 RRDsProcessed:7634
03/10/2006 10:08:32 PM - THOLD: Poller[0] Checking Thresholds
03/10/2006 10:08:26 PM - SYSTEM STATS: Time:205.4527 Method:cactid Processes:4 Threads:50 Hosts:184 HostsPerProcess:46 DataSources:19728 RRDsProcessed:7634
03/10/2006 10:03:35 PM - THOLD: Poller[0] Checking Thresholds
03/10/2006 10:03:32 PM - SYSTEM STATS: Time:211.5586 Method:cactid Processes:4 Threads:50 Hosts:184 HostsPerProcess:46 DataSources:19728 RRDsProcessed:7634
03/10/2006 09:58:14 PM - THOLD: Poller[0] Checking Thresholds
03/10/2006 09:58:09 PM - SYSTEM STATS: Time:188.9735 Method:cactid Processes:4 Threads:50 Hosts:184 HostsPerProcess:46 DataSources:19728 RRDsProcessed:7634

I did tweak the MySQL config a bit:

# Ernie Settings
################
#
# Default key_buffer = 8M
key_buffer = 32M
#
# Default query_cache_size = 0
query_cache_size = 32M
#
# Default innodb_buffer_pool_size = 8M
innodb_buffer_pool_size = 32M
#
# Default comment out log-bin to disable replication
#log-bin
#
# Default myisam_sort_buffer_size = 8M
myisam_sort_buffer_size = 64M
#
# Default read_buffer_size = 128K
read_buffer_size = 2M
#
# Default sort_buffer_size = 2M
sort_buffer_size = 2M
#
# Default table_cache = 64
table_cache = 512
#
# Default thread_cache = 0
thread_cache = 8


# Unaltered Defaults
##################
#
max_allowed_packet = 1M
read_rnd_buffer_size = 4M
thread_concurrency = 8

[mysql]
no-auto-rehash

[isamchk]
key_buffer = 128M
sort_buffer_size = 128M
read_buffer = 2M
write_buffer = 2M

[myisamchk]
key_buffer = 128M
sort_buffer_size = 128M
read_buffer = 2M
write_buffer = 2M

[mysqlhotcopy]
interactive-timeout



I am thinking of upgrading my production server to FreeBSD v6.
Unfortunately I am not confident in my ability to backup my Cacti and MySQL and be able to restore it on another OS.

Is there a one-stop backup plugin or utility (or guide) out there?
Also I like to run on MySQL v5.0.18 upgrading and migrating my existing data from my current 4.x MySQL.
Thank you,

Ernie
http://www.NMSWorld.com
[b]Dual Zeon Dual Core 2.6Ghz / 8GB RAM / 4x15k RPM SATA RAID5[/b]
[b]Cacti Version[/b] - 0.8.7b
[b]Poller Type[/b] - cactid 0.8.7 with Boost v1.7
[b]Server Info[/b] - FreeBSD 7.0-RELEASE
[b]Web Server[/b] - Apache/2.2.6 (Unix) mod_ssl/2.2.6 OpenSSL/0.9.8g DAV/2 PHP/5.2.5 mod_perl/2.0.3 Perl/v5.8.8
[b]PHP[/b] - 5.2.6
[b]MySQL[/b] - 5.0.51b Mod: poller_output ENGINE = MEMORY
[b]RRDTool[/b] - 1.3.0
[b]SNMP[/b] - 5.4.1
[b]Plugins[/b] - Host Info (hostinfo - v0.2), Update Checker (update - v0.3), Network Tools (tools - v0.2), FlowView (flowview - v0.3), Read-only Devices Tab (devices - v0.4), Network Discovery (discovery - v0.8.3), Syslog Monitoring (syslog - v0.5.2), Thresholds (thold - v0.3.9), Device Monitoring (monitor - v0.8.2), PHP Network Weathermap (weathermap - v0.941), SuperLinks (superlinks - v0.72), Report Creator (reports - v0.1b)
Top
Post Reply

Return to “Announcements”

Who is online

Users browsing this forum: No registered users and 2 guests