Missing polls and graphs not displaying correctly

[truelovej]

I am using the following:

Fedora Core 4
Cacti 0.8.6h / Cactid 0.8.6g
RRDTool 1.2.12
Apache 2.0.54
MySQL 4.1.11
PHP 5.0.4

I am trying to poll my network devices every minute. I have updated the crontab file and have created an RRA source for a 1 minute poll.

The problem that I am having is that every x minutes a get 1 polling internal that is missed. I receive no error messages in any of the log files.
I do not know if the problem is related to the RRD files or my Cacti setup.

I have tried switching to cmd.php and I have the same problem.
I do not know what only the input source is showing the problem.

Does anyone know how I can correct this ?

Thanks

John

[truelovej]

I am now seeing these error message but I think its only related to when I am adding new devices to poll. I don't see this message any other time.


03/15/2006 03:18:30 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "update data_template_data set rrd_maximum='|query_ifSpeed|' where local_data_id=111"
03/15/2006 03:18:30 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "update data_template_data set rrd_maximum='|query_ifSpeed|' where local_data_id=110"

Could this be causing the problem or just a programming error ?
I do not find the field rrd_maximum in data_template_data.

I am still getting the graphs with missing data.

[gandalf]

I am now seeing these error message but I think its only related to when I am adding new devices to poll. I don't see this message any other time.


03/15/2006 03:18:30 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "update data_template_data set rrd_maximum='|query_ifSpeed|' where local_data_id=111"
03/15/2006 03:18:30 PM - CMDPHP: Poller[0] ERROR: SQL Exec Failed "update data_template_data set rrd_maximum='|query_ifSpeed|' where local_data_id=110"

Could this be causing the problem or just a programming error ?
I do not find the field rrd_maximum in data_template_data.

I am still getting the graphs with missing data.

This does not correlate to your graph error.
You're using an awfully large rra. This may result in runtime problems. Please post your SYSTEM STATS from cacti.log
Reinhard

[truelovej]

The RRD files are not that big. Each file is only 1.5MB each. I want to be able to record 1 minute of data for 1 month.

I really would like to have 1 minute of data for 1 year. I did have an MRTG solution running with my own custom php code that did gather data for 1 year at 1 minute.
The files were only 8MB each.

The server has enough HD space to handle it.

I am still getting the same gaps in my graphs.


3/17/2006 07:50:05 AM - SYSTEM STATS: Time:3.0677 Method:cactid Processes:1 Threads:1 Hosts:24 HostsPerProcess:24 DataSources:114 RRDsProcessed:59
03/17/2006 07:49:05 AM - SYSTEM STATS: Time:3.0681 Method:cactid Processes:1 Threads:1 Hosts:24 HostsPerProcess:24 DataSources:114 RRDsProcessed:59
03/17/2006 07:48:05 AM - SYSTEM STATS: Time:3.0672 Method:cactid Processes:1 Threads:1 Hosts:24 HostsPerProcess:24 DataSources:114 RRDsProcessed:59
03/17/2006 07:47:05 AM - SYSTEM STATS: Time:3.0660 Method:cactid Processes:1 Threads:1 Hosts:24 HostsPerProcess:24 DataSources:114 RRDsProcessed:59
03/17/2006 07:46:05 AM - SYSTEM STATS: Time:3.0664 Method:cactid Processes:1 Threads:1 Hosts:24 HostsPerProcess:24 DataSources:114 RRDsProcessed:59
03/17/2006 07:45:05 AM - SYSTEM STATS: Time:3.0675 Method:cactid Processes:1 Threads:1 Hosts:24 HostsPerProcess:24 DataSources:114 RRDsProcessed:59

Thanks.

[truelovej]

Does anyone know how I can correct the problem with gaps ?

I have been reading other post and there are several people have the same
type of problem with gaps in the their graphs.

I have modified my php.ini file so that the it looks like the following:

max_execution_time = 120 ; Maximum execution time of each script, in seconds
max_input_time = 120 ; Maximum amount of time each script may spend parsing request data
memory_limit = 64M ; Maximum amount of memory a script may consume (8MB)

Resetting server to see if that fixes the problem.

[gandalf]

The runtime from SYSTEM STATS is ok and will not cause problems. My hint for file size does not mainly touch the size itself, but the rrdtool runtime for dealing with that. May you switch Settings->Logging Level to DEBUG to catch one failure? But be aware of the size the logfile will have when running this for too long.
Reinhard

[truelovej]

Here is the debug information.

I am still getting the gaps in the graphs. I have tried deleting devices and
re-adding them back in. No luck.

I have also tried deleting the rrd files and letting cacti re-create the files, still no luck. I removed many of my devices so that log file would not be huge.

Any help would be greatly appreciated.

Thanks

John T.

[gandalf]

Most of the log relates to Graph Generation (and is therefor of no interest). The rest does not show any of those errors you're complaining about.
Reinhard

[truelovej]

I am not really seeing any errors, just no results for some polls.

Do you have any suggestions as how I can fix it ?

Is it time to delete and reinstall everything ?

Do you think that polling 1 minute is causing any of those problems ?
What should be the correct settings for the RRA for 1 minute polling ?
I am looking to store 1 data point / minute for a max. of 31 days.


I don't know where to go from here. I am getting everything thing else to
work just fine with the exception of the gaps in the graphs.

There is not set interval that the gaps appear, they are semi-random.

Sorry for all the questions...

John T.

[truelovej]

I deleted everything related to cacti.

I have reinstalled cacti, patched it and now everything is working fine.

It has been running for about 45 minutes without a single gap in the graph.
I would have had at least 2 or 3 by now.

The only thing that I did different was that I placed cacti in /var/www/html instead of /var/www/html/cacti.

Or at least that is the only thing that I can remember that I did different.

Thanks for your help lvm.

[gandalf]

This change should not be necessary. But if it runs, ...
Feel free to ask if new problems arise
happy cactiing
Reinhard

[TheWitness]

There is a revised lib/template.php in SVN. Please see if this corrects the problem.

Thanks,

TheWitness