Submit Your CMD.PHP vs. SPINE Metrics Here
Moderators: Developers, Moderators
08/28/2008 01:55:32 PM - SYSTEM STATS: Time:30.4682 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27962
08/28/2008 01:50:30 PM - SYSTEM STATS: Time:28.8209 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27952
08/28/2008 01:45:34 PM - SYSTEM STATS: Time:32.6964 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27962
08/28/2008 01:41:26 PM - SYSTEM STATS: Time:84.3668 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27962
08/28/2008 01:35:47 PM - SYSTEM STATS: Time:44.8065 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936
08/28/2008 01:30:46 PM - SYSTEM STATS: Time:45.5328 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:25:33 PM - SYSTEM STATS: Time:31.3891 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:20:27 PM - SYSTEM STATS: Time:26.3713 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:15:30 PM - SYSTEM STATS: Time:29.0295 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:10:33 PM - SYSTEM STATS: Time:31.7093 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936
08/28/2008 01:05:39 PM - SYSTEM STATS: Time:36.9887 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936
08/28/2008 01:01:11 PM - SYSTEM STATS: Time:70.4295 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936
After some memory-upgrades this system is running really smooth
Dell 1955 blade, dual quad xeon E5335 2Ghz, 18Gb ram, 2*73Gb 10Krpm SAS in raid1. Running debian etch with 2.6.18-6-686-bigmem kernel and rrdtool 1.3.1.gandalf wrote:WOW, that's decent! May you please post your server details?
Reinhard
I'm still having some 'problems' with runtimes ex. when I add some new devices, and at 2AM when there is alot of rrd-stuff happening;
08/30/2008 02:10:50 AM - SYSTEM STATS: Time:46.3380 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337
08/30/2008 02:05:46 AM - SYSTEM STATS: Time:44.2632 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337
08/30/2008 02:02:26 AM - SYSTEM STATS: Time:144.0773 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337
08/30/2008 01:55:31 AM - SYSTEM STATS: Time:30.3803 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337
I'm still running 32bit system (had 2Gb memory in the box up untill last week, damn that extra 16Gb made a difference ), so I'm thinking about reinstalling the box with a 64-bit system to make better use of the memory, and see if I maybe can tune mysql or something. I guess the disks will be my next bottleneck, I would really like to put the rra's on a different disk than the rest of the installation, but that's the sucky part of this otherwise great blade.. it only got space for 2 disks, so then I won't be able to raid them. So I guess this will have to do for now.
Any tips to further increase performance is highly appreciated
- Attachments
-
- Timeline of some updates
- cacti.jpg (193.97 KiB) Viewed 10404 times
Here are my stats after running for almost 6 months...
10/10/2008 01:47:06 PM - SYSTEM BOOST STATS: Time:600.7716 RRDUpdates:1506501
10/10/2008 01:47:05 PM - SYSTEM STATS: Time:123.2782 Method:spine Processes:12 Threads:4 Hosts:1431 HostsPerProcess:120 DataSources:20379 RRDsProcessed:11298
Any suggestions for how to optimize? I'm getting occasional errors like this:
10/10/2008 01:47:07 PM - CMDPHP: Poller[0] FATAL: RRD On Demand Updater Exceeded Runtime Limits!!!
10/10/2008 01:47:06 PM - SYSTEM BOOST STATS: Time:600.7716 RRDUpdates:1506501
10/10/2008 01:47:05 PM - SYSTEM STATS: Time:123.2782 Method:spine Processes:12 Threads:4 Hosts:1431 HostsPerProcess:120 DataSources:20379 RRDsProcessed:11298
Any suggestions for how to optimize? I'm getting occasional errors like this:
10/10/2008 01:47:07 PM - CMDPHP: Poller[0] FATAL: RRD On Demand Updater Exceeded Runtime Limits!!!
10/10/2008 02:10:57 PM - SYSTEM STATS: Time:55.5647 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 02:06:25 PM - SYSTEM STATS: Time:83.3740 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 02:00:56 PM - SYSTEM STATS: Time:54.7026 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:55:53 PM - SYSTEM STATS: Time:51.5866 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:51:22 PM - SYSTEM STATS: Time:80.2035 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:46:24 PM - SYSTEM STATS: Time:83.2492 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:40:52 PM - SYSTEM STATS: Time:50.8180 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:35:51 PM - SYSTEM STATS: Time:49.2804 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:31:05 PM - SYSTEM STATS: Time:64.2670 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:25:52 PM - SYSTEM STATS: Time:50.4442 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:20:50 PM - SYSTEM STATS: Time:47.7887 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:17:36 PM - SYSTEM STATS: Time:154.6632 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:11:08 PM - SYSTEM STATS: Time:66.1795 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
Running on an HP DL380 G4; dual dual-core 3.20GHz Intel Xeon; 3 GB of RAM, 2*36GB 15K disk for OS in RAID 1, 4*72GB disks for data in RAID 5.
10/10/2008 02:06:25 PM - SYSTEM STATS: Time:83.3740 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 02:00:56 PM - SYSTEM STATS: Time:54.7026 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:55:53 PM - SYSTEM STATS: Time:51.5866 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:51:22 PM - SYSTEM STATS: Time:80.2035 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:46:24 PM - SYSTEM STATS: Time:83.2492 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:40:52 PM - SYSTEM STATS: Time:50.8180 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:35:51 PM - SYSTEM STATS: Time:49.2804 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:31:05 PM - SYSTEM STATS: Time:64.2670 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:25:52 PM - SYSTEM STATS: Time:50.4442 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:20:50 PM - SYSTEM STATS: Time:47.7887 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:17:36 PM - SYSTEM STATS: Time:154.6632 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:11:08 PM - SYSTEM STATS: Time:66.1795 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
Running on an HP DL380 G4; dual dual-core 3.20GHz Intel Xeon; 3 GB of RAM, 2*36GB 15K disk for OS in RAID 1, 4*72GB disks for data in RAID 5.
Cacti Version - 0.8.7b
Plugin Architecture - 2.1
Poller Type - Cactid v
Server Info - Linux 2.6.18-53.el5
Web Server - Apache/2.2.3 (CentOS)
PHP - 5.1.6
PHP Extensions - libxml, xml, wddx, tokenizer, sysvshm, sysvsem, sysvmsg, standard, SimpleXML, sockets, SPL, shmop, session, Reflection, pspell, posix, mime_magic, iconv, hash, gmp, gettext, ftp, exif, date, curl, ctype, calendar, bz2, zlib, pcre, openssl, apache2handler, dbase, gd, json, ldap, mbstring, mysql, mysqli, PDO, pdo_mysql, pdo_sqlite, rrdtool, snmp
MySQL - 5.0.22-log
RRDTool - 1.2.23
SNMP - 5.3.1
Plugins
- Global Plugin Settings (settings - v0.5)
Thresholds (thold - v0.3.9)
Large Site Performane Booster for Cacti (boost - v1.8)
Host Info (hostinfo - v0.2)
Cycle Graphs (Cycle Graphs - v0.4)
Device Monitoring (monitor - v0.8.2)
Network Tools (tools - v0.3)
killspike (killspike - v0.1.0a)
Update Checker (update - v0.4)
-
- Cacti User
- Posts: 141
- Joined: Thu Apr 10, 2008 6:52 pm
Optimal Settings
I've been trying to find the optimal settings of processes and threads by reading in this topic. Here are my results. Any feedback would be great.
Time:33.4453 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:155
Time:33.0334 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:278 RRDsProcessed:153
Time:32.4967 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:156
Time:38.9115 Method:spine Processes:2 Threads:30 Hosts:187 HostsPerProcess:94 DataSources:283 RRDsProcessed:159
Time:52.2100 Method:spine Processes:2 Threads:30 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:159
Time:56.3337 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:155
Time:57.2530 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:278 RRDsProcessed:155
Time:54.2952 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:284 RRDsProcessed:158
Time:54.3770 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:283 RRDsProcessed:162
Time:56.7570 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:159
Time:56.7095 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:155
Time:54.0052 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:276 RRDsProcessed:155
Time:53.9228 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:284 RRDsProcessed:156
Time:44.6062 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:285 RRDsProcessed:162
Time:45.5313 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:159
Time:47.0882 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:151
Time:43.4350 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:276 RRDsProcessed:155
Time:41.2545 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:284 RRDsProcessed:158
Time:38.5832 Method:spine Processes:3 Threads:15 Hosts:187 HostsPerProcess:63 DataSources:285 RRDsProcessed:162
Time:39.4540 Method:spine Processes:3 Threads:15 Hosts:187 HostsPerProcess:63 DataSources:280 RRDsProcessed:159
Time:44.3088 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:155
Time:44.0469 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:276 RRDsProcessed:155
Time:44.5946 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:284 RRDsProcessed:158
Time:43.0379 Method:spine Processes:4 Threads:6 Hosts:187 HostsPerProcess:47 DataSources:285 RRDsProcessed:162
Time:40.2794 Method:spine Processes:4 Threads:6 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:159
Time:33.3341 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:151
Time:37.3519 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:276 RRDsProcessed:155
Time:32.6199 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:284 RRDsProcessed:158
Time:33.6118 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:283 RRDsProcessed:157
Time:31.7842 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:158
Time:31.9777 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:154
Time:32.7864 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:278 RRDsProcessed:155
PowerEdge 1750
Two Xeon Processors
Either 4 or 8 GB of ram
CactiEZ 0.4 (CentOS)
Cacti 0.8.7b
** Update ***
I killed two spine processes that were stuck. Results below:
11/18/2008 09:33:29 AM - SYSTEM STATS: Time:26.3965 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:285 RRDsProcessed:159
11/18/2008 09:32:29 AM - SYSTEM STATS: Time:26.2987 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:162
11/18/2008 09:31:29 AM - SYSTEM STATS: Time:26.3429 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:159
11/18/2008 09:30:29 AM - SYSTEM STATS: Time:26.2473 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:154
Time:33.4453 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:155
Time:33.0334 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:278 RRDsProcessed:153
Time:32.4967 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:156
Time:38.9115 Method:spine Processes:2 Threads:30 Hosts:187 HostsPerProcess:94 DataSources:283 RRDsProcessed:159
Time:52.2100 Method:spine Processes:2 Threads:30 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:159
Time:56.3337 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:155
Time:57.2530 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:278 RRDsProcessed:155
Time:54.2952 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:284 RRDsProcessed:158
Time:54.3770 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:283 RRDsProcessed:162
Time:56.7570 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:159
Time:56.7095 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:155
Time:54.0052 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:276 RRDsProcessed:155
Time:53.9228 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:284 RRDsProcessed:156
Time:44.6062 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:285 RRDsProcessed:162
Time:45.5313 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:159
Time:47.0882 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:151
Time:43.4350 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:276 RRDsProcessed:155
Time:41.2545 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:284 RRDsProcessed:158
Time:38.5832 Method:spine Processes:3 Threads:15 Hosts:187 HostsPerProcess:63 DataSources:285 RRDsProcessed:162
Time:39.4540 Method:spine Processes:3 Threads:15 Hosts:187 HostsPerProcess:63 DataSources:280 RRDsProcessed:159
Time:44.3088 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:155
Time:44.0469 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:276 RRDsProcessed:155
Time:44.5946 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:284 RRDsProcessed:158
Time:43.0379 Method:spine Processes:4 Threads:6 Hosts:187 HostsPerProcess:47 DataSources:285 RRDsProcessed:162
Time:40.2794 Method:spine Processes:4 Threads:6 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:159
Time:33.3341 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:151
Time:37.3519 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:276 RRDsProcessed:155
Time:32.6199 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:284 RRDsProcessed:158
Time:33.6118 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:283 RRDsProcessed:157
Time:31.7842 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:158
Time:31.9777 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:154
Time:32.7864 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:278 RRDsProcessed:155
PowerEdge 1750
Two Xeon Processors
Either 4 or 8 GB of ram
CactiEZ 0.4 (CentOS)
Cacti 0.8.7b
** Update ***
I killed two spine processes that were stuck. Results below:
11/18/2008 09:33:29 AM - SYSTEM STATS: Time:26.3965 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:285 RRDsProcessed:159
11/18/2008 09:32:29 AM - SYSTEM STATS: Time:26.2987 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:162
11/18/2008 09:31:29 AM - SYSTEM STATS: Time:26.3429 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:159
11/18/2008 09:30:29 AM - SYSTEM STATS: Time:26.2473 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:154
Hi
I have managed to decrease polling time by about 15 seconds. I increased RAM from 1G to 3G, although this didn't have an immediate effect. I noticed that the server immediately started using the additional RAM. I then decreased processes from 4 to 1 and threads from 35 to 25. I also played around with various mysql settings. This seemed to make the most difference.
Old stats
12/05/2008 04:06:12 PM - SYSTEM STATS: Time:71.3051 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 04:01:08 PM - RECACHE STATS: RecacheTime:0.8967 HostsRecached:2
12/05/2008 04:01:06 PM - SYSTEM STATS: Time:65.6011 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 03:56:11 PM - RECACHE STATS: RecacheTime:1.3018 HostsRecached:3
12/05/2008 03:56:09 PM - SYSTEM STATS: Time:68.5273 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 03:51:07 PM - SYSTEM STATS: Time:66.7348 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 03:46:07 PM - RECACHE STATS: RecacheTime:0.5623 HostsRecached:1
Current stats
12/10/2008 12:40:57 PM - SYSTEM STATS: Time:56.2447 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:35:56 PM - RECACHE STATS: RecacheTime:0.9426 HostsRecached:2
12/10/2008 12:35:54 PM - SYSTEM STATS: Time:54.1913 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:30:57 PM - RECACHE STATS: RecacheTime:0.9300 HostsRecached:3
12/10/2008 12:30:55 PM - SYSTEM STATS: Time:54.8245 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:25:56 PM - RECACHE STATS: RecacheTime:1.3311 HostsRecached:4
12/10/2008 12:25:54 PM - SYSTEM STATS: Time:53.9049 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:20:58 PM - RECACHE STATS: RecacheTime:1.8075 HostsRecached:4
12/10/2008 12:20:55 PM - SYSTEM STATS: Time:55.2151 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:15:57 PM - RECACHE STATS: RecacheTime:0.4554 HostsRecached:1
Regards
Jay
I have managed to decrease polling time by about 15 seconds. I increased RAM from 1G to 3G, although this didn't have an immediate effect. I noticed that the server immediately started using the additional RAM. I then decreased processes from 4 to 1 and threads from 35 to 25. I also played around with various mysql settings. This seemed to make the most difference.
Old stats
12/05/2008 04:06:12 PM - SYSTEM STATS: Time:71.3051 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 04:01:08 PM - RECACHE STATS: RecacheTime:0.8967 HostsRecached:2
12/05/2008 04:01:06 PM - SYSTEM STATS: Time:65.6011 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 03:56:11 PM - RECACHE STATS: RecacheTime:1.3018 HostsRecached:3
12/05/2008 03:56:09 PM - SYSTEM STATS: Time:68.5273 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 03:51:07 PM - SYSTEM STATS: Time:66.7348 Method:cactid Processes:4 Threads:35 Hosts:419 HostsPerProcess:105 DataSources:5626 RRDsProcessed:3105
12/05/2008 03:46:07 PM - RECACHE STATS: RecacheTime:0.5623 HostsRecached:1
Current stats
12/10/2008 12:40:57 PM - SYSTEM STATS: Time:56.2447 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:35:56 PM - RECACHE STATS: RecacheTime:0.9426 HostsRecached:2
12/10/2008 12:35:54 PM - SYSTEM STATS: Time:54.1913 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:30:57 PM - RECACHE STATS: RecacheTime:0.9300 HostsRecached:3
12/10/2008 12:30:55 PM - SYSTEM STATS: Time:54.8245 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:25:56 PM - RECACHE STATS: RecacheTime:1.3311 HostsRecached:4
12/10/2008 12:25:54 PM - SYSTEM STATS: Time:53.9049 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:20:58 PM - RECACHE STATS: RecacheTime:1.8075 HostsRecached:4
12/10/2008 12:20:55 PM - SYSTEM STATS: Time:55.2151 Method:cactid Processes:1 Threads:25 Hosts:419 HostsPerProcess:419 DataSources:5626 RRDsProcessed:3086
12/10/2008 12:15:57 PM - RECACHE STATS: RecacheTime:0.4554 HostsRecached:1
Regards
Jay
Cacti Version 0.8.7e, Spine 0.8.7e, Apache 2.2.15, Mysql 5.0.88, PHP 5.2.13, RRDTool 1.2.30, NET-SNMP 5.5
Quad Core AMD Opteron Processor 2384, 2.70Ghz, 2GB RAM , 1 CPU used
Windows Server 2003 (X64), VMWARE ESX
Plugins: Aggregate 0.75
SYSTEM STATS: Time:12.5140 Method:spine Processes:2 Threads:15 Hosts:400 HostsPerProcess:200 DataSources:2909 RRDsProcessed:1384
Quad Core AMD Opteron Processor 2384, 2.70Ghz, 2GB RAM , 1 CPU used
Windows Server 2003 (X64), VMWARE ESX
Plugins: Aggregate 0.75
SYSTEM STATS: Time:12.5140 Method:spine Processes:2 Threads:15 Hosts:400 HostsPerProcess:200 DataSources:2909 RRDsProcessed:1384
12/14/2008 10:54:01 PM - SYSTEM STATS: Time:239.8569 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:46:55 PM - SYSTEM STATS: Time:113.2382 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:43:09 PM - SYSTEM STATS: Time:187.1455 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:38:23 PM - SYSTEM STATS: Time:200.4354 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:32:53 PM - SYSTEM STATS: Time:169.9492 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:28:29 PM - SYSTEM STATS: Time:205.5648 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:46:55 PM - SYSTEM STATS: Time:113.2382 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:43:09 PM - SYSTEM STATS: Time:187.1455 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:38:23 PM - SYSTEM STATS: Time:200.4354 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:32:53 PM - SYSTEM STATS: Time:169.9492 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
12/14/2008 10:28:29 PM - SYSTEM STATS: Time:205.5648 Method:spine Processes:1 Threads:15 Hosts:250 HostsPerProcess:250 DataSources:9667 RRDsProcessed:5794
My stats:
2008-12-18 13:18:51 Time:230.8425 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
2008-12-18 13:23:30 Time:210.5970 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
2008-12-18 13:28:47 Time:227.6655 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
2008-12-18 13:33:33 Time:213.5130 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
Will submit results once done.
Cheers
2008-12-18 13:18:51 Time:230.8425 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
2008-12-18 13:23:30 Time:210.5970 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
2008-12-18 13:28:47 Time:227.6655 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
2008-12-18 13:33:33 Time:213.5130 Method:cmd.php Processes:30 Threads:N/A Hosts:888 HostsPerProcess:30 DataSources:12604 RRDsProcessed:0
Planing to upgrade Cacti to latest release and migrate to Spine...Cacti Version - 0.8.6j
Plugin Architecture - 1.1
Poller Type - CMD.php
Server Info - Windows NT 5.2
Web Server - Microsoft-IIS/6.0
PHP - 5.2.6
PHP Extensions - bcmath, calendar, com_dotnet, ctype, session, filter, ftp, hash, iconv, json, odbc, pcre, Reflection, date, libxml, standard, tokenizer, zlib, SimpleXML, dom, SPL, wddx, xml, xmlreader, xmlwriter, ISAPI, mbstring, gd, ldap, mysql, snmp, sockets
MySQL - 5.0.67-community-nt-log
RRDTool - 1.2.28
SNMP - 5.4
Plugins
- Large Site Performane Booster for Cacti (boost - v2.1)
Thresholds (thold - v0.3.5)
Telnet and ssh http and htts Plugin (telnet - v0.5)
Netflow Plugin (Netflow - v0.3)
Network Tools (tools - v0.2)
Update Checker (update - v0.3)
Report Creator (reports - v0.3)
Network Discovery (discovery - v0.8.4)
Device Tracking (mactrack - v1.1)
Cacti-ReportIt (reportit - v0.6.1)
Simple Links page (links - v0.3)
Poller Performance Report (pollperf - v0.1)
CactiReport - make PDF reports (CactiReport - v0.1)
Host Info (hostinfo - v0.1)
Dataquery (dataquery - v0.1.2a)
Cacti Log View (CLog - v1.1)
Dataquery (dataquery - v0.1.2a)
ipsubnet - v0.4b
Will submit results once done.
Cheers
- Attachments
-
- Poller stats
- poller.png (23.8 KiB) Viewed 9206 times
cmd.php
Graphs 471
Data Sources SNMP: 130
SNMP Query: 394
Total: 524
Poller Information
Interval 60
Type spine
Items Action[0]: 1125
Total: 1125
spine12/19/2008 02:13:15 PM - SYSTEM STATS: Time:15.5738 Method:cmd.php Processes:2 Threads:N/A Hosts:48 HostsPerProcess:24 DataSources:320 RRDsProcessed:144
Hosts 4912/19/2008 02:17:04 PM - SYSTEM STATS: Time:4.5469 Method:spine Processes:2 Threads:2 Hosts:48 HostsPerProcess:24 DataSources:324 RRDsProcessed:148
Graphs 471
Data Sources SNMP: 130
SNMP Query: 394
Total: 524
Poller Information
Interval 60
Type spine
Items Action[0]: 1125
Total: 1125
Cacti v.087g + PAv2.9
- TheWitness
- Developer
- Posts: 17047
- Joined: Tue May 14, 2002 5:08 pm
- Location: MI, USA
- Contact:
Here are some interesting stats. Should grow to over 300k when done:
TheWitness
Using Boost 2.2. Here are the sats there:01/27/2009 12:36:15 PM - SYSTEM STATS: Time:73.3625 Method:spine Processes:4 Threads:32 Hosts:630 HostsPerProcess:158 DataSources:140899 RRDsProcessed:0
01/27/2009 12:31:21 PM - SYSTEM STATS: Time:79.9145 Method:spine Processes:4 Threads:32 Hosts:630 HostsPerProcess:158 DataSources:140899 RRDsProcessed:0
01/27/2009 12:26:23 PM - SYSTEM STATS: Time:81.9764 Method:spine Processes:4 Threads:32 Hosts:630 HostsPerProcess:158 DataSources:140899 RRDsProcessed:0
01/27/2009 12:21:17 PM - SYSTEM STATS: Time:76.2402 Method:spine Processes:4 Threads:32 Hosts:630 HostsPerProcess:158 DataSources:140899 RRDsProcessed:0
01/27/2009 12:16:22 PM - SYSTEM STATS: Time:80.0326 Method:spine Processes:4 Threads:32 Hosts:630 HostsPerProcess:158 DataSources:140899 RRDsProcessed:0
Interestingly enough, MyISAM performance is superior to MEMORY but slows down boost with regard to delete time. Insert times for some reason were slow on MEMORY tables. Spine finishes in a jiffy. I am still trying to figure out why the inserts into the MEMORY table are slow.01/27/2009 11:34:29 AM - SYSTEM BOOST STATS: Time:779.1984 RRDUpdates:2509290
01/27/2009 10:05:00 AM - SYSTEM BOOST STATS: Time:805.8270 RRDUpdates:2509164
01/27/2009 08:34:59 AM - SYSTEM BOOST STATS: Time:814.1850 RRDUpdates:2509349
01/27/2009 07:03:34 AM - SYSTEM BOOST STATS: Time:735.2206 RRDUpdates:2510462
01/27/2009 05:34:12 AM - SYSTEM BOOST STATS: Time:774.3557 RRDUpdates:2509781
TheWitness
True understanding begins only when we realize how little we truly understand...
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Life is an adventure, let yours begin with Cacti!
Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages
For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
-
- Cacti User
- Posts: 101
- Joined: Tue May 24, 2005 8:46 am
- Location: Rochester, New Hampshire
- Contact:
cmd.php
02/03/2009 03:54:22 PM - SYSTEM STATS: Time:262.1603 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6290 RRDsProcessed:3737
02/03/2009 03:59:42 PM - SYSTEM STATS: Time:279.2652 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6290 RRDsProcessed:3737
with the occasional hiccups
02/03/2009 01:06:59 PM - SYSTEM STATS: Time:417.6055 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6236 RRDsProcessed:3682
02/03/2009 01:09:03 PM - SYSTEM STATS: Time:242.2682 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6236 RRDsProcessed:3682
Spine
02/03/2009 05:21:41 PM - SYSTEM STATS: Time:98.8667 Method:spine Processes:1 Threads:50 Hosts:42 HostsPerProcess:42 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:27:50 PM - SYSTEM STATS: Time:168.9628 Method:spine Processes:1 Threads:50 Hosts:42 HostsPerProcess:42 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:32:31 PM - SYSTEM STATS: Time:149.9167 Method:spine Processes:1 Threads:50 Hosts:42 HostsPerProcess:42 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:36:41 PM - SYSTEM STATS: Time:100.2989 Method:spine Processes:10 Threads:50 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:41:33 PM - SYSTEM STATS: Time:92.9652 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:46:37 PM - SYSTEM STATS: Time:97.4754 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
Trying to tweak it to make it run as fast a possible.
Sun X4100 with 2 dual core opterons (2.2GHz) with 4GB RAM running Solaris 10 x86.
Cacti is running within a "zone" of the main box, which has 8 other zones running as well, but none nearly as hard as this zone.
Edit-----
Spine is having hiccups too
02/03/2009 05:52:10 PM - SYSTEM STATS: Time:127.4296 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:58:53 PM - SYSTEM STATS: Time:231.7583 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 06:07:37 PM - SYSTEM STATS: Time:455.2680 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 06:08:30 PM - SYSTEM STATS: Time:208.8820 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 03:54:22 PM - SYSTEM STATS: Time:262.1603 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6290 RRDsProcessed:3737
02/03/2009 03:59:42 PM - SYSTEM STATS: Time:279.2652 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6290 RRDsProcessed:3737
with the occasional hiccups
02/03/2009 01:06:59 PM - SYSTEM STATS: Time:417.6055 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6236 RRDsProcessed:3682
02/03/2009 01:09:03 PM - SYSTEM STATS: Time:242.2682 Method:cmd.php Processes:50 Threads:N/A Hosts:42 HostsPerProcess:1 DataSources:6236 RRDsProcessed:3682
Spine
02/03/2009 05:21:41 PM - SYSTEM STATS: Time:98.8667 Method:spine Processes:1 Threads:50 Hosts:42 HostsPerProcess:42 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:27:50 PM - SYSTEM STATS: Time:168.9628 Method:spine Processes:1 Threads:50 Hosts:42 HostsPerProcess:42 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:32:31 PM - SYSTEM STATS: Time:149.9167 Method:spine Processes:1 Threads:50 Hosts:42 HostsPerProcess:42 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:36:41 PM - SYSTEM STATS: Time:100.2989 Method:spine Processes:10 Threads:50 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:41:33 PM - SYSTEM STATS: Time:92.9652 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:46:37 PM - SYSTEM STATS: Time:97.4754 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
Trying to tweak it to make it run as fast a possible.
Sun X4100 with 2 dual core opterons (2.2GHz) with 4GB RAM running Solaris 10 x86.
Cacti is running within a "zone" of the main box, which has 8 other zones running as well, but none nearly as hard as this zone.
Edit-----
Spine is having hiccups too
02/03/2009 05:52:10 PM - SYSTEM STATS: Time:127.4296 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 05:58:53 PM - SYSTEM STATS: Time:231.7583 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 06:07:37 PM - SYSTEM STATS: Time:455.2680 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
02/03/2009 06:08:30 PM - SYSTEM STATS: Time:208.8820 Method:spine Processes:10 Threads:20 Hosts:42 HostsPerProcess:5 DataSources:6290 RRDsProcessed:3737
Who is online
Users browsing this forum: No registered users and 3 guests