Gaps on diskspaces

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

Post Reply
brononius
Posts: 27
Joined: Fri Dec 30, 2011 4:53 am

Gaps on diskspaces

Post by brononius »

Hey,

My cacti installation is working great, except for local diskspace. :oops:
From time to time, the diskspaces give a gap.

My server is being graphed for cpu load, network interfaces, disk usuage, services...
And on the time that the disks show a gap, the rest is working fine.

I'm using 'SNMP - Get Mounted Partitions' for the diskspace.
I'm also using snmp for my processor graphs. So i'm pretty sure that snmp is acting normally.

Image

Image
Cacti: 0.8.7i PIA on Ubuntu (linuxmce) with NET-SNMP 5.4.1 / RRDTool 1.2.x
Plugins: Manage062, Syslog122, Mactrack29, Settings071, Weathermap097a, Quicktree02, Thold049, Configmanager0826, Aggregate070, Realtime043, Nettools015
Private use: 24 hosts (and trying to integrate it into linuxmce)
Professional use 1635 nodes with 3616 graphs (backup / syslog / weathermaps...)
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: Gaps on diskspaces

Post by gandalf »

It is known, that Windows systems respsond quite slowly to especially this Data Query. In most cases, it helps to increase the timeout for this host.
But I don't hesitate to advertise my pure SNMP replacement of this Data Query, see 4th ink of my sig.
R.
brononius
Posts: 27
Joined: Fri Dec 30, 2011 4:53 am

Re: Gaps on diskspaces

Post by brononius »

Hey,

This is all local stuff.
So it's a linux machine... :$

But i'll give the http://docs.cacti.net/usertemplate:data ... disk_usage a try.
Hereby the graphs:

The 'old/standard' graphs
Image

And your usertemplate
Image
Cacti: 0.8.7i PIA on Ubuntu (linuxmce) with NET-SNMP 5.4.1 / RRDTool 1.2.x
Plugins: Manage062, Syslog122, Mactrack29, Settings071, Weathermap097a, Quicktree02, Thold049, Configmanager0826, Aggregate070, Realtime043, Nettools015
Private use: 24 hosts (and trying to integrate it into linuxmce)
Professional use 1635 nodes with 3616 graphs (backup / syslog / weathermaps...)
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: Gaps on diskspaces

Post by gandalf »

brononius wrote:Hey,

This is all local stuff.
So it's a linux machine... :$
I'm sorry for my mistake.
R.
User avatar
brononi
Cacti User
Posts: 123
Joined: Tue Aug 29, 2006 1:58 am
Location: Belgium
Contact:

Re: Gaps on diskspaces

Post by brononi »

Seems that i still have the gaps... :oops:
Any thoughs?
  • Cacti: 0.8.8f / Plugin Architecture Version: 3.1 / Linuxbased
  • Third Party: Apache 2.4.12 / PHP 5.6.11 / NET-SNMP version 5.3.2.2 / RRDTool 1.5.4
  • Plugins: Configmanager 0.826 / Aggregate 0.70B2 / Manage 0.6.2 / Weathermap 0.97a / Thold 0.4.9 / Quicktree 0.2 / Realtime 0.5 / Settings 0.7
  • Data:Host 1341 / Graphs 6752
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: Gaps on diskspaces

Post by gandalf »

Please see Cacti log and find out
- whether the poller exceeds runtime (see: SYSTEM STATS)
- or this specific data source throws errors (warning will be printed for that data source, then)
R.
User avatar
brononi
Cacti User
Posts: 123
Joined: Tue Aug 29, 2006 1:58 am
Location: Belgium
Contact:

Re: Gaps on diskspaces

Post by brononi »

In the logs, i couldn't find anything.

But my logging wasn't very high (low > statistics and error). :oops:
I've just put it to medium (statistics, errors and results)...

So i'll check in a while if i can find anything...
  • Cacti: 0.8.8f / Plugin Architecture Version: 3.1 / Linuxbased
  • Third Party: Apache 2.4.12 / PHP 5.6.11 / NET-SNMP version 5.3.2.2 / RRDTool 1.5.4
  • Plugins: Configmanager 0.826 / Aggregate 0.70B2 / Manage 0.6.2 / Weathermap 0.97a / Thold 0.4.9 / Quicktree 0.2 / Realtime 0.5 / Settings 0.7
  • Data:Host 1341 / Graphs 6752
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: Gaps on diskspaces

Post by gandalf »

And what about the SYSTEM STATS? Does the poller end within time?
R.
User avatar
brononi
Cacti User
Posts: 123
Joined: Tue Aug 29, 2006 1:58 am
Location: Belgium
Contact:

Re: Gaps on diskspaces

Post by brononi »

Not sure how/what i need to check here... :oops:

My poller (cmd.php) is set each 5 minutes.

grep 'SYSTEM STATS' cacti.log

Code: Select all

01/20/2013 08:20:23 AM - SYSTEM STATS: Time:20.8637 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:136
01/20/2013 08:25:11 AM - SYSTEM STATS: Time:9.3133 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:108
01/20/2013 09:50:10 AM - SYSTEM STATS: Time:9.1310 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:127
01/20/2013 09:50:10 AM - SYSTEM STATS: Time:9.1381 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:120
01/20/2013 09:55:20 AM - SYSTEM STATS: Time:18.6217 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 10:00:22 AM - SYSTEM STATS: Time:20.4244 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 10:05:18 AM - SYSTEM STATS: Time:17.4990 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 10:10:20 AM - SYSTEM STATS: Time:18.7372 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 10:15:19 AM - SYSTEM STATS: Time:17.6133 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 10:20:26 AM - SYSTEM STATS: Time:25.1793 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 10:25:22 AM - SYSTEM STATS: Time:20.3739 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 10:30:11 AM - SYSTEM STATS: Time:9.2979 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:124
01/20/2013 10:30:11 AM - SYSTEM STATS: Time:9.3030 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:125
01/20/2013 10:35:21 AM - SYSTEM STATS: Time:19.2307 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 10:40:23 AM - SYSTEM STATS: Time:21.1560 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 10:45:19 AM - SYSTEM STATS: Time:17.9908 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 10:50:19 AM - SYSTEM STATS: Time:17.7954 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 10:55:26 AM - SYSTEM STATS: Time:24.4902 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 11:00:20 AM - SYSTEM STATS: Time:18.3752 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 11:05:17 AM - SYSTEM STATS: Time:14.7827 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 11:10:25 AM - SYSTEM STATS: Time:22.8670 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 11:15:24 AM - SYSTEM STATS: Time:21.8150 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:135
01/20/2013 11:20:13 AM - SYSTEM STATS: Time:11.9320 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:143
01/20/2013 11:25:11 AM - SYSTEM STATS: Time:9.1943 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 11:25:11 AM - SYSTEM STATS: Time:9.1933 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:101
01/20/2013 11:30:18 AM - SYSTEM STATS: Time:15.9600 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:143
01/20/2013 11:35:13 AM - SYSTEM STATS: Time:11.8610 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:143
01/20/2013 11:40:20 AM - SYSTEM STATS: Time:18.0467 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:143
01/20/2013 11:45:17 AM - SYSTEM STATS: Time:14.7289 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:142
01/20/2013 11:50:21 AM - SYSTEM STATS: Time:19.3069 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 11:55:19 AM - SYSTEM STATS: Time:17.6831 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:143
01/20/2013 12:00:22 PM - SYSTEM STATS: Time:20.4647 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 12:05:24 PM - SYSTEM STATS: Time:22.3479 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 12:10:23 PM - SYSTEM STATS: Time:21.3976 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 12:15:11 PM - SYSTEM STATS: Time:9.1616 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:117
01/20/2013 12:15:11 PM - SYSTEM STATS: Time:9.1647 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:137
01/20/2013 12:20:19 PM - SYSTEM STATS: Time:17.4471 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 12:25:14 PM - SYSTEM STATS: Time:12.1316 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:143
01/20/2013 12:30:23 PM - SYSTEM STATS: Time:21.1490 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 12:35:15 PM - SYSTEM STATS: Time:13.4806 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:143
01/20/2013 12:40:26 PM - SYSTEM STATS: Time:25.0199 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 12:45:24 PM - SYSTEM STATS: Time:22.4885 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:143
01/20/2013 12:50:23 PM - SYSTEM STATS: Time:21.5968 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:143
01/20/2013 12:55:20 PM - SYSTEM STATS: Time:18.9661 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 01:00:15 PM - SYSTEM STATS: Time:12.8088 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:134
01/20/2013 01:05:18 PM - SYSTEM STATS: Time:17.2885 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 01:10:23 PM - SYSTEM STATS: Time:21.2976 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:134
01/20/2013 01:15:23 PM - SYSTEM STATS: Time:21.9878 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 01:20:20 PM - SYSTEM STATS: Time:18.1008 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 01:25:21 PM - SYSTEM STATS: Time:18.9325 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 01:30:22 PM - SYSTEM STATS: Time:19.6737 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 01:35:21 PM - SYSTEM STATS: Time:19.6366 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 01:40:24 PM - SYSTEM STATS: Time:21.7382 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 01:45:24 PM - SYSTEM STATS: Time:22.2902 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
01/20/2013 01:50:24 PM - SYSTEM STATS: Time:22.5317 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
Last edited by brononi on Mon Jan 21, 2013 8:58 am, edited 2 times in total.
  • Cacti: 0.8.8f / Plugin Architecture Version: 3.1 / Linuxbased
  • Third Party: Apache 2.4.12 / PHP 5.6.11 / NET-SNMP version 5.3.2.2 / RRDTool 1.5.4
  • Plugins: Configmanager 0.826 / Aggregate 0.70B2 / Manage 0.6.2 / Weathermap 0.97a / Thold 0.4.9 / Quicktree 0.2 / Realtime 0.5 / Settings 0.7
  • Data:Host 1341 / Graphs 6752
User avatar
brononi
Cacti User
Posts: 123
Joined: Tue Aug 29, 2006 1:58 am
Location: Belgium
Contact:

Re: Gaps on diskspaces

Post by brononi »

At 13h30, i've got another gap.

And these are the system stats:

Code: Select all

cacti.log:01/21/2013 01:25:19 PM - SYSTEM STATS: Time:17.7698 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
cacti.log:01/21/2013 01:30:22 PM - SYSTEM STATS: Time:20.7121 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:144
cacti.log:01/21/2013 01:35:11 PM - SYSTEM STATS: Time:9.6208 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:120
cacti.log:01/21/2013 01:35:11 PM - SYSTEM STATS: Time:9.6230 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:138
cacti.log:01/21/2013 01:40:27 PM - SYSTEM STATS: Time:25.5266 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:143
cacti.log:01/21/2013 01:45:11 PM - SYSTEM STATS: Time:9.6827 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:133
I've got 2 error in my logs that are returning:

Code: Select all

01/21/2013 01:30:01 PM - POLLER: Poller[0] NOTE: Cron is configured to run too often!  The Poller Interval is '300' seconds, with a minimum Cron period of '
300' seconds, but only 0 seconds have passed since the poller last ran.

01/21/2013 01:35:07 PM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) va
lues (240, 'hdd_used', '2013-01-21 13:35:06', '1900544')'
I think this has something to do with the fact that my poller is being ran 2 times?
Once each 5 minutes in /etc/crontab and once each 5 minutes in /etc/cron.d/cacti
I've just disabled the one in crontab. I hope this will solve it...
  • Cacti: 0.8.8f / Plugin Architecture Version: 3.1 / Linuxbased
  • Third Party: Apache 2.4.12 / PHP 5.6.11 / NET-SNMP version 5.3.2.2 / RRDTool 1.5.4
  • Plugins: Configmanager 0.826 / Aggregate 0.70B2 / Manage 0.6.2 / Weathermap 0.97a / Thold 0.4.9 / Quicktree 0.2 / Realtime 0.5 / Settings 0.7
  • Data:Host 1341 / Graphs 6752
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: Gaps on diskspaces

Post by gandalf »

brononi wrote:

Code: Select all

cacti.log:01/21/2013 01:35:11 PM - SYSTEM STATS: Time:9.6208 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:120
cacti.log:01/21/2013 01:35:11 PM - SYSTEM STATS: Time:9.6230 Method:cmd.php Processes:8 Threads:N/A Hosts:38 HostsPerProcess:5 DataSources:259 RRDsProcessed:138
There shoulb nit be two pollers running in parallel. This will cause issues like the DB issue you've found. You will have to find out, why two pollers are running in parallel
R.
User avatar
brononi
Cacti User
Posts: 123
Joined: Tue Aug 29, 2006 1:58 am
Location: Belgium
Contact:

Re: Gaps on diskspaces

Post by brononi »

One installation was done manual, where i've put the poller in crontab.
And along the way, an installation was tried by apt-get. And i guess that this automatic process has put the poller in init.d.

After removing one of the poller, no issues have been seen anymore on the graphs. So let's hope that this was the issue...
  • Cacti: 0.8.8f / Plugin Architecture Version: 3.1 / Linuxbased
  • Third Party: Apache 2.4.12 / PHP 5.6.11 / NET-SNMP version 5.3.2.2 / RRDTool 1.5.4
  • Plugins: Configmanager 0.826 / Aggregate 0.70B2 / Manage 0.6.2 / Weathermap 0.97a / Thold 0.4.9 / Quicktree 0.2 / Realtime 0.5 / Settings 0.7
  • Data:Host 1341 / Graphs 6752
Post Reply

Who is online

Users browsing this forum: No registered users and 3 guests