Submit Your CMD.PHP vs. SPINE Metrics Here

Important information about Cacti developments that all users should be interested in.

Moderators: Developers, Moderators

Post Reply
mccloud
Posts: 1
Joined: Fri Jun 15, 2007 7:37 pm

Post by mccloud »

08/26/2008 05:01:55 AM - SYSTEM STATS: Time:113.6542 Method:spine Processes:3 Threads:40 Hosts:1061 HostsPerProcess:354 DataSources:10779 RRDsProcessed:4474
Top
frdrk
Cacti User
Posts: 55
Joined: Fri Jul 06, 2007 2:27 pm

Post by frdrk »


08/28/2008 01:55:32 PM - SYSTEM STATS: Time:30.4682 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27962
08/28/2008 01:50:30 PM - SYSTEM STATS: Time:28.8209 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27952
08/28/2008 01:45:34 PM - SYSTEM STATS: Time:32.6964 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27962
08/28/2008 01:41:26 PM - SYSTEM STATS: Time:84.3668 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27962
08/28/2008 01:35:47 PM - SYSTEM STATS: Time:44.8065 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936
08/28/2008 01:30:46 PM - SYSTEM STATS: Time:45.5328 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:25:33 PM - SYSTEM STATS: Time:31.3891 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:20:27 PM - SYSTEM STATS: Time:26.3713 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:15:30 PM - SYSTEM STATS: Time:29.0295 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:10:33 PM - SYSTEM STATS: Time:31.7093 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936
08/28/2008 01:05:39 PM - SYSTEM STATS: Time:36.9887 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936
08/28/2008 01:01:11 PM - SYSTEM STATS: Time:70.4295 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936


After some memory-upgrades this system is running really smooth :)
Top
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:
Contact gandalf

Post by gandalf »

WOW, that's decent! May you please post your server details?
Reinhard
Top
frdrk
Cacti User
Posts: 55
Joined: Fri Jul 06, 2007 2:27 pm

Post by frdrk »

gandalf wrote:WOW, that's decent! May you please post your server details?
Reinhard
Dell 1955 blade, dual quad xeon E5335 2Ghz, 18Gb ram, 2*73Gb 10Krpm SAS in raid1. Running debian etch with 2.6.18-6-686-bigmem kernel and rrdtool 1.3.1.

I'm still having some 'problems' with runtimes ex. when I add some new devices, and at 2AM when there is alot of rrd-stuff happening;
08/30/2008 02:10:50 AM - SYSTEM STATS: Time:46.3380 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337
08/30/2008 02:05:46 AM - SYSTEM STATS: Time:44.2632 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337
08/30/2008 02:02:26 AM - SYSTEM STATS: Time:144.0773 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337
08/30/2008 01:55:31 AM - SYSTEM STATS: Time:30.3803 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337


I'm still running 32bit system (had 2Gb memory in the box up untill last week, damn that extra 16Gb made a difference :D), so I'm thinking about reinstalling the box with a 64-bit system to make better use of the memory, and see if I maybe can tune mysql or something. I guess the disks will be my next bottleneck, I would really like to put the rra's on a different disk than the rest of the installation, but that's the sucky part of this otherwise great blade.. it only got space for 2 disks, so then I won't be able to raid them. So I guess this will have to do for now.

Any tips to further increase performance is highly appreciated :)
Attachments
Timeline of some updates
Timeline of some updates
cacti.jpg (193.97 KiB) Viewed 10337 times
Top
peecee
Cacti User
Posts: 146
Joined: Tue Feb 26, 2008 7:26 am

Post by peecee »

Here are my stats after running for almost 6 months...

10/10/2008 01:47:06 PM - SYSTEM BOOST STATS: Time:600.7716 RRDUpdates:1506501
10/10/2008 01:47:05 PM - SYSTEM STATS: Time:123.2782 Method:spine Processes:12 Threads:4 Hosts:1431 HostsPerProcess:120 DataSources:20379 RRDsProcessed:11298

Any suggestions for how to optimize? I'm getting occasional errors like this:

10/10/2008 01:47:07 PM - CMDPHP: Poller[0] FATAL: RRD On Demand Updater Exceeded Runtime Limits!!!
Top
lints
Cacti User
Posts: 107
Joined: Thu Nov 08, 2007 2:00 pm
Location: Ottawa, Canada

Post by lints »

10/10/2008 02:10:57 PM - SYSTEM STATS: Time:55.5647 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 02:06:25 PM - SYSTEM STATS: Time:83.3740 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 02:00:56 PM - SYSTEM STATS: Time:54.7026 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:55:53 PM - SYSTEM STATS: Time:51.5866 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:51:22 PM - SYSTEM STATS: Time:80.2035 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:46:24 PM - SYSTEM STATS: Time:83.2492 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:40:52 PM - SYSTEM STATS: Time:50.8180 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:35:51 PM - SYSTEM STATS: Time:49.2804 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:31:05 PM - SYSTEM STATS: Time:64.2670 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:25:52 PM - SYSTEM STATS: Time:50.4442 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:20:50 PM - SYSTEM STATS: Time:47.7887 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:17:36 PM - SYSTEM STATS: Time:154.6632 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:11:08 PM - SYSTEM STATS: Time:66.1795 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769

Running on an HP DL380 G4; dual dual-core 3.20GHz Intel Xeon; 3 GB of RAM, 2*36GB 15K disk for OS in RAID 1, 4*72GB disks for data in RAID 5.
Cacti Version - 0.8.7b
Plugin Architecture - 2.1
Poller Type - Cactid v
Server Info - Linux 2.6.18-53.el5
Web Server - Apache/2.2.3 (CentOS)
PHP - 5.1.6
PHP Extensions - libxml, xml, wddx, tokenizer, sysvshm, sysvsem, sysvmsg, standard, SimpleXML, sockets, SPL, shmop, session, Reflection, pspell, posix, mime_magic, iconv, hash, gmp, gettext, ftp, exif, date, curl, ctype, calendar, bz2, zlib, pcre, openssl, apache2handler, dbase, gd, json, ldap, mbstring, mysql, mysqli, PDO, pdo_mysql, pdo_sqlite, rrdtool, snmp
MySQL - 5.0.22-log
RRDTool - 1.2.23
SNMP - 5.3.1
Plugins
  • Global Plugin Settings (settings - v0.5)
    Thresholds (thold - v0.3.9)
    Large Site Performane Booster for Cacti (boost - v1.8)
    Host Info (hostinfo - v0.2)
    Cycle Graphs (Cycle Graphs - v0.4)
    Device Monitoring (monitor - v0.8.2)
    Network Tools (tools - v0.3)
    killspike (killspike - v0.1.0a)
    Update Checker (update - v0.4)
Top
computer_guru
Cacti User
Posts: 141
Joined: Thu Apr 10, 2008 6:52 pm

Optimal Settings

Post by computer_guru »

I've been trying to find the optimal settings of processes and threads by reading in this topic. Here are my results. Any feedback would be great.


Time:33.4453 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:155
Time:33.0334 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:278 RRDsProcessed:153
Time:32.4967 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:156
Time:38.9115 Method:spine Processes:2 Threads:30 Hosts:187 HostsPerProcess:94 DataSources:283 RRDsProcessed:159
Time:52.2100 Method:spine Processes:2 Threads:30 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:159
Time:56.3337 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:155
Time:57.2530 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:278 RRDsProcessed:155
Time:54.2952 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:284 RRDsProcessed:158
Time:54.3770 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:283 RRDsProcessed:162
Time:56.7570 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:159
Time:56.7095 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:155
Time:54.0052 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:276 RRDsProcessed:155
Time:53.9228 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:284 RRDsProcessed:156
Time:44.6062 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:285 RRDsProcessed:162
Time:45.5313 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:159
Time:47.0882 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:151
Time:43.4350 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:276 RRDsProcessed:155
Time:41.2545 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:284 RRDsProcessed:158
Time:38.5832 Method:spine Processes:3 Threads:15 Hosts:187 HostsPerProcess:63 DataSources:285 RRDsProcessed:162
Time:39.4540 Method:spine Processes:3 Threads:15 Hosts:187 HostsPerProcess:63 DataSources:280 RRDsProcessed:159
Time:44.3088 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:155
Time:44.0469 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:276 RRDsProcessed:155
Time:44.5946 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:284 RRDsProcessed:158
Time:43.0379 Method:spine Processes:4 Threads:6 Hosts:187 HostsPerProcess:47 DataSources:285 RRDsProcessed:162
Time:40.2794 Method:spine Processes:4 Threads:6 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:159
Time:33.3341 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:151
Time:37.3519 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:276 RRDsProcessed:155
Time:32.6199 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:284 RRDsProcessed:158
Time:33.6118 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:283 RRDsProcessed:157
Time:31.7842 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:158
Time:31.9777 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:154
Time:32.7864 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:278 RRDsProcessed:155


PowerEdge 1750
Two Xeon Processors
Either 4 or 8 GB of ram

CactiEZ 0.4 (CentOS)
Cacti 0.8.7b

** Update ***

I killed two spine processes that were stuck. Results below:

11/18/2008 09:33:29 AM - SYSTEM STATS: Time:26.3965 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:285 RRDsProcessed:159
11/18/2008 09:32:29 AM - SYSTEM STATS: Time:26.2987 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:162
11/18/2008 09:31:29 AM - SYSTEM STATS: Time:26.3429 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:159
11/18/2008 09:30:29 AM - SYSTEM STATS: Time:26.2473 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:154
Top
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:
Contact gandalf

Post by gandalf »

I'd like to reduce threads to 10-15.
Are you running lots of scripts?
What about average latency to your targets? Are you able to use SNMP V2?
Around 30 sec. for 300 data sources is HUGE. We do 25k Data Sources in around 60-70 sec (which is bad as well)
Reinhard
Top
jay
Cacti User
Posts: 390
Joined: Wed Aug 31, 2005 8:55 am
Location: Bristol, England

Post by jay »

Hi

I have managed to decrease polling time by about 15 seconds. I increased RAM from 1G to 3G, although this didn't have an immediate effect. I noticed that the server immediately started using the additional RAM. I then decreased processes from 4 to 1 and threads from 35 to 25. I also played around with various mysql settings. This seemed to make the most difference.

Old stats

12/05/2008 04:06:12 PM - SYSTEM STATS: Time:71.3051 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 04:01:08 PM - RECACHE STATS: RecacheTime:0.8967 HostsRecached:2
12/05/2008 04:01:06 PM - SYSTEM STATS: Time:65.6011 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 03:56:11 PM - RECACHE STATS: RecacheTime:1.3018 HostsRecached:3
12/05/2008 03:56:09 PM - SYSTEM STATS: Time:68.5273 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 03:51:07 PM - SYSTEM STATS: Time:66.7348 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 03:46:07 PM - RECACHE STATS: RecacheTime:0.5623 HostsRecached:1


Current stats

12/10/2008 12:40:57 PM - SYSTEM STATS: Time:56.2447 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:35:56 PM - RECACHE STATS: RecacheTime:0.9426 HostsRecached:2
12/10/2008 12:35:54 PM - SYSTEM STATS: Time:54.1913 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:30:57 PM - RECACHE STATS: RecacheTime:0.9300 HostsRecached:3
12/10/2008 12:30:55 PM - SYSTEM STATS: Time:54.8245 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:25:56 PM - RECACHE STATS: RecacheTime:1.3311 HostsRecached:4
12/10/2008 12:25:54 PM - SYSTEM STATS: Time:53.9049 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:20:58 PM - RECACHE STATS: RecacheTime:1.8075 HostsRecached:4
12/10/2008 12:20:55 PM - SYSTEM STATS: Time:55.2151 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:15:57 PM - RECACHE STATS: RecacheTime:0.4554 HostsRecached:1


Regards

Jay
Cacti Version 0.8.7e, Spine 0.8.7e, Apache 2.2.15, Mysql 5.0.88, PHP 5.2.13, RRDTool 1.2.30, NET-SNMP 5.5
Quad Core AMD Opteron Processor 2384, 2.70Ghz, 2GB RAM , 1 CPU used
Windows Server 2003 (X64), VMWARE ESX
Plugins: Aggregate 0.75

SYSTEM STATS: Time:12.5140 Method:spine Processes:2 Threads:15 Hosts:400 HostsPerProcess:200 DataSources:2909 RRDsProcessed:1384
Top
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:
Contact gandalf

Post by gandalf »

Using spine should give you another bump. Unfortunately, rrdtool boost as of 1.2.26 and later is available only for linux, AFAIK.
Reinhard
Top
valleed
Posts: 13
Joined: Sun Nov 30, 2008 9:46 pm

Post by valleed »

12/14/2008 10:54:01 PM - SYSTEM STATS: Time:239.8569 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:46:55 PM - SYSTEM STATS: Time:113.2382 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:43:09 PM - SYSTEM STATS: Time:187.1455 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:38:23 PM - SYSTEM STATS: Time:200.4354 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:32:53 PM - SYSTEM STATS: Time:169.9492 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:28:29 PM - SYSTEM STATS: Time:205.5648 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
Top
TheHack
Posts: 28
Joined: Fri Apr 28, 2006 4:02 am

Post by TheHack »

My stats:
2008-12-18 13:18:51 Time:230.8425 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
2008-12-18 13:23:30 Time:210.5970 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
2008-12-18 13:28:47 Time:227.6655 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
2008-12-18 13:33:33 Time:213.5130 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
Cacti Version - 0.8.6j
Plugin Architecture - 1.1
Poller Type - CMD.php
Server Info - Windows NT 5.2
Web Server - Microsoft-IIS/6.0
PHP - 5.2.6
PHP Extensions - bcmath, calendar, com_dotnet, ctype, session, filter, ftp, hash, iconv, json, odbc, pcre, Reflection, date, libxml, standard, tokenizer, zlib, SimpleXML, dom, SPL, wddx, xml, xmlreader, xmlwriter, ISAPI, mbstring, gd, ldap, mysql, snmp, sockets
MySQL - 5.0.67-community-nt-log
RRDTool - 1.2.28
SNMP - 5.4
Plugins
  • Large Site Performane Booster for Cacti (boost - v2.1)
    Thresholds (thold - v0.3.5)
    Telnet and ssh http and htts Plugin (telnet - v0.5)
    Netflow Plugin (Netflow - v0.3)
    Network Tools (tools - v0.2)
    Update Checker (update - v0.3)
    Report Creator (reports - v0.3)
    Network Discovery (discovery - v0.8.4)
    Device Tracking (mactrack - v1.1)
    Cacti-ReportIt (reportit - v0.6.1)
    Simple Links page (links - v0.3)
    Poller Performance Report (pollperf - v0.1)
    CactiReport - make PDF reports (CactiReport - v0.1)
    Host Info (hostinfo - v0.1)
    Dataquery (dataquery - v0.1.2a)
    Cacti Log View (CLog - v1.1)
    Dataquery (dataquery - v0.1.2a)
    ipsubnet - v0.4b
Planing to upgrade Cacti to latest release and migrate to Spine...
Will submit results once done.
Cheers
Attachments
Poller stats
Poller stats
poller.png (23.8 KiB) Viewed 9139 times
Top
L0gRuS
Cacti User
Posts: 127
Joined: Thu Nov 06, 2008 7:57 am

Post by L0gRuS »

cmd.php

12/19/2008 02:13:15 PM - SYSTEM STATS: Time:15.5738 Method:cmd.php Processes:2 Threads:N/A Hosts:48 HostsPerProcess:24 DataSources:320 RRDsProcessed:144
spine
12/19/2008 02:17:04 PM - SYSTEM STATS: Time:4.5469 Method:spine Processes:2 Threads:2 Hosts:48 HostsPerProcess:24 DataSources:324 RRDsProcessed:148
Hosts 49
Graphs 471
Data Sources SNMP: 130
SNMP Query: 394
Total: 524

Poller Information
Interval 60
Type spine
Items Action[0]: 1125
Total: 1125
Cacti v.087g + PAv2.9
Top
User avatar
TheWitness
Developer
Posts: 17007
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Here are some interesting stats. Should grow to over 300k when done:
01/27/2009 12:36:15 PM - SYSTEM STATS: Time:73.3625 Method:spine Processes:4 Threads:32 Hosts:630 HostsPerProcess:158 DataSources:140899 RRDsProcessed:0
01/27/2009 12:31:21 PM - SYSTEM STATS: Time:79.9145 Method:spine Processes:4 Threads:32 Hosts:630 HostsPerProcess:158 DataSources:140899 RRDsProcessed:0
01/27/2009 12:26:23 PM - SYSTEM STATS: Time:81.9764 Method:spine Processes:4 Threads:32 Hosts:630 HostsPerProcess:158 DataSources:140899 RRDsProcessed:0
01/27/2009 12:21:17 PM - SYSTEM STATS: Time:76.2402 Method:spine Processes:4 Threads:32 Hosts:630 HostsPerProcess:158 DataSources:140899 RRDsProcessed:0
01/27/2009 12:16:22 PM - SYSTEM STATS: Time:80.0326 Method:spine Processes:4 Threads:32 Hosts:630 HostsPerProcess:158 DataSources:140899 RRDsProcessed:0
Using Boost 2.2. Here are the sats there:
01/27/2009 11:34:29 AM - SYSTEM BOOST STATS: Time:779.1984 RRDUpdates:2509290
01/27/2009 10:05:00 AM - SYSTEM BOOST STATS: Time:805.8270 RRDUpdates:2509164
01/27/2009 08:34:59 AM - SYSTEM BOOST STATS: Time:814.1850 RRDUpdates:2509349
01/27/2009 07:03:34 AM - SYSTEM BOOST STATS: Time:735.2206 RRDUpdates:2510462
01/27/2009 05:34:12 AM - SYSTEM BOOST STATS: Time:774.3557 RRDUpdates:2509781
Interestingly enough, MyISAM performance is superior to MEMORY but slows down boost with regard to delete time. Insert times for some reason were slow on MEMORY tables. Spine finishes in a jiffy. I am still trying to figure out why the inserts into the MEMORY table are slow.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
jbarbieri
Cacti User
Posts: 101
Joined: Tue May 24, 2005 8:46 am
Location: Rochester, New Hampshire
Contact:
Contact jbarbieri

Post by jbarbieri »

cmd.php

02/03/2009 03:54:22 PM - SYSTEM STATS: Time:262.1603 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6290 RRDsProcessed:3737
02/03/2009 03:59:42 PM - SYSTEM STATS: Time:279.2652 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6290 RRDsProcessed:3737


with the occasional hiccups


02/03/2009 01:06:59 PM - SYSTEM STATS: Time:417.6055 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6236 RRDsProcessed:3682
02/03/2009 01:09:03 PM - SYSTEM STATS: Time:242.2682 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6236 RRDsProcessed:3682




Spine


02/03/2009 05:21:41 PM - SYSTEM STATS: Time:98.8667 Method:spine Processes:1 Threads:50 Hosts:42 HostsPerProcess:42 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:27:50 PM - SYSTEM STATS: Time:168.9628 Method:spine Processes:1 Threads:50 Hosts:42 HostsPerProcess:42 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:32:31 PM - SYSTEM STATS: Time:149.9167 Method:spine Processes:1 Threads:50 Hosts:42 HostsPerProcess:42 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:36:41 PM - SYSTEM STATS: Time:100.2989 Method:spine Processes:10 Threads:50 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:41:33 PM - SYSTEM STATS: Time:92.9652 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:46:37 PM - SYSTEM STATS: Time:97.4754 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737



Trying to tweak it to make it run as fast a possible.


Sun X4100 with 2 dual core opterons (2.2GHz) with 4GB RAM running Solaris 10 x86.

Cacti is running within a "zone" of the main box, which has 8 other zones running as well, but none nearly as hard as this zone.


Edit-----

Spine is having hiccups too :(


02/03/2009 05:52:10 PM - SYSTEM STATS: Time:127.4296 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:58:53 PM - SYSTEM STATS: Time:231.7583 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 06:07:37 PM - SYSTEM STATS: Time:455.2680 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 06:08:30 PM - SYSTEM STATS: Time:208.8820 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
Top
Post Reply

Return to “Announcements”

Who is online

Users browsing this forum: No registered users and 1 guest