Slow cactid performance

Post support questions that directly relate to Linux/Unix operating systems.

Moderators: Developers, Moderators

User avatar
TheWitness
Developer
Posts: 17062
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

You've done more than enough. Your system load is high, what size are your RRD's (in kbytes)?

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
jgisler
Cacti User
Posts: 63
Joined: Wed Sep 28, 2005 1:12 pm

Post by jgisler »

94664 is the file size for each one currently.

Just an FYI also, I currently have an older version of cacti running on the same machine that I am about to retire & replace with the current build.

Thinking that this was a contributing factor, I disabled the crontab job for that poller for a period of time to see if that would free up the system load. It still remained that same. I will disable it fully on Wed as I now have the gapping issue resolved for it seems. No more poller failures 296secs.
jgisler
Cacti User
Posts: 63
Joined: Wed Sep 28, 2005 1:12 pm

Post by jgisler »

I've stopped the old version of Cacti as of last night. The load on the machine seems lower but the cactid times are still around the same.


10/18/2005 01:29:58 PM - SYSTEM STATS: Time:296.9291 Method:cactid Processes:6 Threads:40 Hosts:428 HostsPerProcess:72 DataSources:1396 RRDsProcessed:701
10/18/2005 01:29:57 PM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/18/2005 01:24:56 PM - SYSTEM STATS: Time:294.8893 Method:cactid Processes:6 Threads:40 Hosts:425 HostsPerProcess:71 DataSources:1390 RRDsProcessed:699
10/18/2005 01:24:55 PM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/18/2005 01:19:54 PM - SYSTEM STATS: Time:295.0149 Method:cactid Processes:6 Threads:40 Hosts:419 HostsPerProcess:70 DataSources:1378 RRDsProcessed:693
10/18/2005 01:19:54 PM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/18/2005 01:14:58 PM - SYSTEM STATS: Time:297.3782 Method:cactid Processes:6 Threads:40 Hosts:418 HostsPerProcess:70 DataSources:1376 RRDsProcessed:692
10/18/2005 01:14:57 PM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/18/2005 01:09:57 PM - SYSTEM STATS: Time:297.0598 Method:cactid Processes:6 Threads:40 Hosts:418 HostsPerProcess:70 DataSources:1376 RRDsProcessed:691
10/18/2005 01:09:56 PM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/18/2005 01:04:57 PM - SYSTEM STATS: Time:296.9152 Method:cactid Processes:6 Threads:40 Hosts:418 HostsPerProcess:70 DataSources:1376 RRDsProcessed:692
10/18/2005 01:04:56 PM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/18/2005 12:59:57 PM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/18/2005 12:56:48 PM - SYSTEM STATS: Time:107.7975 Method:cactid Processes:6 Threads:40 Hosts:418 HostsPerProcess:70 DataSources:1376 RRDsProcessed:678
10/18/2005 12:55:12 PM - POLLER: Poller[0] Maximum runtime of 296 seconds exceeded. Exiting.
10/18/2005 12:55:02 PM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/18/2005 12:49:57 PM - SYSTEM STATS: Time:297.3547 Method:cactid Processes:6 Threads:40 Hosts:418 HostsPerProcess:70 DataSources:1376 RRDsProcessed:692
User avatar
TheWitness
Developer
Posts: 17062
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

Try 2 processes and 15 threads.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
jgisler
Cacti User
Posts: 63
Joined: Wed Sep 28, 2005 1:12 pm

Post by jgisler »

I have tried that previous when you asked that. There was no change. I have that set now as you've asked.

What about

Script and Script Server Timeout Value? set to 300

The Maximum SNMP OID's Per SNMP Get Request? set to 20
jgisler
Cacti User
Posts: 63
Joined: Wed Sep 28, 2005 1:12 pm

Post by jgisler »

Could this be related to slow polling from certain routers/switches?
User avatar
TheWitness
Developer
Posts: 17062
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

Script server timeout should be no more than 20 seconds. OID's are Ok where they are if you are not getting a lot of timeouts.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
jgisler
Cacti User
Posts: 63
Joined: Wed Sep 28, 2005 1:12 pm

Post by jgisler »

Change script timeouts to 20
User avatar
TheWitness
Developer
Posts: 17062
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

yup.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
jgisler
Cacti User
Posts: 63
Joined: Wed Sep 28, 2005 1:12 pm

Post by jgisler »

10/18/2005 04:29:57 PM - SYSTEM STATS: Time:297.0940 Method:cactid Processes:2 Threads:15 Hosts:428 HostsPerProcess:214 DataSources:1396 RRDsProcessed:701
10/18/2005 04:29:57 PM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
User avatar
TheWitness
Developer
Posts: 17062
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

Without logging into your system, I am at a loss....

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
jgisler
Cacti User
Posts: 63
Joined: Wed Sep 28, 2005 1:12 pm

Post by jgisler »

possible PM for loggin info so you can look around?
jgisler
Cacti User
Posts: 63
Joined: Wed Sep 28, 2005 1:12 pm

Post by jgisler »

Interesting findings. It actually was doing polling in a decent time frame. What's odd is, only for a period of time. This is after I bumped the processes from 2 to 4 & threads from 15 to 20.

I was getting more of these POLLER: Poller[0] Maximum runtime of 296 seconds exceeded. Exiting.

with it set to 2 & 15

10/19/2005 12:32:03 PM - SYSTEM STATS: Time:122.7682 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 12:26:56 PM - SYSTEM STATS: Time:115.9558 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 12:21:55 PM - SYSTEM STATS: Time:114.2930 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 12:16:49 PM - SYSTEM STATS: Time:108.0793 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 12:11:58 PM - SYSTEM STATS: Time:117.5286 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 12:07:04 PM - SYSTEM STATS: Time:123.4921 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 12:02:23 PM - SYSTEM STATS: Time:142.6817 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 11:57:12 AM - SYSTEM STATS: Time:131.0680 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 11:52:11 AM - SYSTEM STATS: Time:131.8129 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 11:49:56 AM - SYSTEM STATS: Time:295.5539 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:702
10/19/2005 11:49:56 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 11:42:04 AM - SYSTEM STATS: Time:122.0414 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 11:37:01 AM - SYSTEM STATS: Time:120.9519 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 11:31:58 AM - SYSTEM STATS: Time:118.2594 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 11:27:08 AM - SYSTEM STATS: Time:127.4996 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 11:22:00 AM - SYSTEM STATS: Time:120.1308 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 11:17:00 AM - SYSTEM STATS: Time:116.4432 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 11:11:57 AM - SYSTEM STATS: Time:116.5246 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 11:06:55 AM - SYSTEM STATS: Time:114.1867 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 11:02:00 AM - SYSTEM STATS: Time:119.7805 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 10:56:52 AM - SYSTEM STATS: Time:111.7390 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 10:51:51 AM - SYSTEM STATS: Time:111.1801 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 10:46:52 AM - SYSTEM STATS: Time:111.8635 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 10:41:53 AM - SYSTEM STATS: Time:113.0802 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 10:36:55 AM - SYSTEM STATS: Time:115.5107 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 10:34:57 AM - SYSTEM STATS: Time:296.5233 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 10:34:56 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 10:26:58 AM - SYSTEM STATS: Time:118.0236 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 10:22:11 AM - SYSTEM STATS: Time:130.4032 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 10:17:12 AM - SYSTEM STATS: Time:131.4570 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 10:12:10 AM - SYSTEM STATS: Time:129.4383 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 10:07:17 AM - SYSTEM STATS: Time:136.1609 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 10:02:20 AM - SYSTEM STATS: Time:133.2805 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:56:54 AM - SYSTEM STATS: Time:113.3716 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:51:52 AM - SYSTEM STATS: Time:111.6444 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:46:56 AM - SYSTEM STATS: Time:115.3307 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:41:54 AM - SYSTEM STATS: Time:113.2285 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:36:54 AM - SYSTEM STATS: Time:113.3695 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:32:00 AM - SYSTEM STATS: Time:119.5663 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:26:54 AM - SYSTEM STATS: Time:113.7371 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:21:54 AM - SYSTEM STATS: Time:113.2296 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:16:57 AM - SYSTEM STATS: Time:116.3769 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:11:52 AM - SYSTEM STATS: Time:111.4582 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:06:51 AM - SYSTEM STATS: Time:110.5721 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 09:02:02 AM - SYSTEM STATS: Time:121.8750 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:56:50 AM - SYSTEM STATS: Time:110.4178 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:51:55 AM - SYSTEM STATS: Time:115.0219 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:46:54 AM - SYSTEM STATS: Time:113.8451 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:41:55 AM - SYSTEM STATS: Time:114.8530 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:36:59 AM - SYSTEM STATS: Time:118.8389 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:32:10 AM - SYSTEM STATS: Time:129.6346 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:27:01 AM - SYSTEM STATS: Time:120.8331 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:22:00 AM - SYSTEM STATS: Time:120.5089 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:16:59 AM - SYSTEM STATS: Time:119.1934 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:12:02 AM - SYSTEM STATS: Time:121.5797 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:07:06 AM - SYSTEM STATS: Time:126.2791 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 08:02:06 AM - SYSTEM STATS: Time:125.9151 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 07:57:02 AM - SYSTEM STATS: Time:121.8889 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 07:51:59 AM - SYSTEM STATS: Time:118.4993 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 07:46:58 AM - SYSTEM STATS: Time:117.7534 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 07:41:59 AM - SYSTEM STATS: Time:118.6630 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 07:37:02 AM - SYSTEM STATS: Time:121.2610 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 07:34:57 AM - SYSTEM STATS: Time:296.5830 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 07:34:57 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 07:29:57 AM - SYSTEM STATS: Time:296.8766 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 07:29:57 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 07:24:57 AM - SYSTEM STATS: Time:296.7317 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 07:24:57 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 07:17:02 AM - SYSTEM STATS: Time:121.6429 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 07:11:56 AM - SYSTEM STATS: Time:115.5104 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 07:06:46 AM - SYSTEM STATS: Time:105.8830 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 07:01:58 AM - SYSTEM STATS: Time:118.3019 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:56:47 AM - SYSTEM STATS: Time:107.1133 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:52:16 AM - SYSTEM STATS: Time:136.0544 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:47:25 AM - SYSTEM STATS: Time:144.4086 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:42:09 AM - SYSTEM STATS: Time:128.6679 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:37:17 AM - SYSTEM STATS: Time:136.5798 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:32:23 AM - SYSTEM STATS: Time:141.8279 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:26:57 AM - SYSTEM STATS: Time:116.3590 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:21:53 AM - SYSTEM STATS: Time:112.5938 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:16:59 AM - SYSTEM STATS: Time:118.9963 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:12:01 AM - SYSTEM STATS: Time:120.8994 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:06:59 AM - SYSTEM STATS: Time:118.4254 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 06:02:07 AM - SYSTEM STATS: Time:127.4008 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 05:56:55 AM - SYSTEM STATS: Time:115.2383 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 05:51:50 AM - SYSTEM STATS: Time:110.3317 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 05:47:02 AM - SYSTEM STATS: Time:122.5113 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 05:42:02 AM - SYSTEM STATS: Time:121.3381 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 05:39:57 AM - SYSTEM STATS: Time:296.9423 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 05:39:56 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 05:34:56 AM - SYSTEM STATS: Time:296.5729 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 05:34:56 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 05:29:57 AM - SYSTEM STATS: Time:296.8945 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 05:29:56 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 05:24:57 AM - SYSTEM STATS: Time:297.1911 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 05:24:56 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 05:16:58 AM - SYSTEM STATS: Time:117.1982 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 05:12:08 AM - SYSTEM STATS: Time:127.7451 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 05:07:11 AM - SYSTEM STATS: Time:130.1605 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 05:02:17 AM - SYSTEM STATS: Time:136.6233 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:57:12 AM - SYSTEM STATS: Time:131.6651 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:52:11 AM - SYSTEM STATS: Time:130.9639 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:47:02 AM - SYSTEM STATS: Time:120.6171 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:41:59 AM - SYSTEM STATS: Time:118.6959 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:37:00 AM - SYSTEM STATS: Time:119.4936 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:32:01 AM - SYSTEM STATS: Time:121.2029 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:26:54 AM - SYSTEM STATS: Time:114.0548 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:21:53 AM - SYSTEM STATS: Time:112.7584 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:16:52 AM - SYSTEM STATS: Time:111.6951 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:12:00 AM - SYSTEM STATS: Time:119.7809 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:07:18 AM - SYSTEM STATS: Time:137.4136 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 04:02:18 AM - SYSTEM STATS: Time:138.0430 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 03:57:05 AM - SYSTEM STATS: Time:125.7070 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 03:52:08 AM - SYSTEM STATS: Time:128.0891 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 03:49:56 AM - SYSTEM STATS: Time:296.1188 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:705
10/19/2005 03:49:55 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 03:44:57 AM - SYSTEM STATS: Time:296.5846 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 03:44:57 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 03:39:58 AM - SYSTEM STATS: Time:296.9985 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 03:39:57 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 03:34:57 AM - SYSTEM STATS: Time:296.0798 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 03:34:56 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 03:29:58 AM - SYSTEM STATS: Time:296.9020 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 03:29:58 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 03:22:05 AM - SYSTEM STATS: Time:124.5130 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 03:19:56 AM - SYSTEM STATS: Time:296.6249 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 03:19:55 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 03:14:56 AM - SYSTEM STATS: Time:295.8698 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
10/19/2005 03:14:55 AM - CACTID: Poller[0] ERROR: Cactid Timed Out While Processing Hosts Internal
10/19/2005 03:06:53 AM - SYSTEM STATS: Time:110.7195 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 03:02:04 AM - SYSTEM STATS: Time:124.0381 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 02:56:55 AM - SYSTEM STATS: Time:114.6243 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 02:51:54 AM - SYSTEM STATS: Time:113.8400 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 02:46:55 AM - SYSTEM STATS: Time:115.0426 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 02:41:57 AM - SYSTEM STATS: Time:116.5454 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 02:37:00 AM - SYSTEM STATS: Time:119.8288 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 02:32:02 AM - SYSTEM STATS: Time:120.7702 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:707
10/19/2005 02:29:57 AM - SYSTEM STATS: Time:296.8993 Method:cactid Processes:4 Threads:20 Hosts:432 HostsPerProcess:108 DataSources:1404 RRDsProcessed:706
User avatar
TheWitness
Developer
Posts: 17062
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

I would say you are having a problem with scripts.

Larry
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
jgisler
Cacti User
Posts: 63
Joined: Wed Sep 28, 2005 1:12 pm

Post by jgisler »

It seems to be relative to the time of day. Between 1am - 1pm times look to be -150 ms on the cactid polling. 295+ ms outside that window. Could it be network traffic? We are a CDN with alot of traffic.

If it's scripts, what & where should I look to get an idea of what script is causing it. I use quite a few generic snmp OID data sources, nothing really crazy outside of that. Mostly monitoring of nothing but bandwidth.

Thanks for the replies Larry. Always appreciated.
Post Reply

Who is online

Users browsing this forum: No registered users and 3 guests