data collection problem
Moderators: Developers, Moderators
data collection problem
Hi eveyone,
Now i have another problem. I'm using 0.8.8a v of cacti. I've just added all my backbone cisco routers as device. After that created some graphs like CPU or interface in/out bits. But i have interruptions in most of my graphs. One of the example is below. It is the CPU graph one of my backbone routers. You can see that i cannot have any data since ~2 hours.
But when i try to get the data with snmpwalk, i receive the correct data and do not any any timeout or error from the router
As i said before, i have this problem for more than 80% of my graphs. What might be the problem? Do i have to change the version of cacti i have installed? What would you prefer for troubleshooting?
Regards,
Utku
Now i have another problem. I'm using 0.8.8a v of cacti. I've just added all my backbone cisco routers as device. After that created some graphs like CPU or interface in/out bits. But i have interruptions in most of my graphs. One of the example is below. It is the CPU graph one of my backbone routers. You can see that i cannot have any data since ~2 hours.
But when i try to get the data with snmpwalk, i receive the correct data and do not any any timeout or error from the router
As i said before, i have this problem for more than 80% of my graphs. What might be the problem? Do i have to change the version of cacti i have installed? What would you prefer for troubleshooting?
Regards,
Utku
Re: data collection problem
Hi again,
Also i saw the logs below. They might be related with this situation
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (133, '5min_cpu', '2013-02-06 09:25:15', '21')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (130, '5min_cpu', '2013-02-06 09:25:14', '15')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (127, '5min_cpu', '2013-02-06 09:25:14', '3')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (124, '5min_cpu', '2013-02-06 09:25:14', '3')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (121, '5min_cpu', '2013-02-06 09:25:14', '13')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (118, '5min_cpu', '2013-02-06 09:25:14', '4')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (115, '5min_cpu', '2013-02-06 09:25:14', '6')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (112, '5min_cpu', '2013-02-06 09:25:14', '28')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (103, '5min_cpu', '2013-02-06 09:25:13', '9')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (100, '5min_cpu', '2013-02-06 09:25:13', '6')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (97, '5min_cpu', '2013-02-06 09:25:13', '0')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (132, '5min_cpu', '2013-02-06 09:25:13', '7')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (126, '5min_cpu', '2013-02-06 09:25:12', '11')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (123, '5min_cpu', '2013-02-06 09:25:12', '13')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (91, '5min_cpu', '2013-02-06 09:25:12', '0')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (120, '5min_cpu', '2013-02-06 09:25:12', '22')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (85, '5min_cpu', '2013-02-06 09:25:12', '1')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (88, '5min_cpu', '2013-02-06 09:25:12', '11')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (79, '5min_cpu', '2013-02-06 09:25:11', '7')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (76, '5min_cpu', '2013-02-06 09:25:11', '2')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (111, '5min_cpu', '2013-02-06 09:25:11', '59')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (108, '5min_cpu', '2013-02-06 09:25:11', '7')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (105, '5min_cpu', '2013-02-06 09:25:11', '1')'
02/06/2013 09:25:13 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (73, '5min_cpu', '2013-02-06 09:25:11', '9')'
Also i saw the logs below. They might be related with this situation
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (133, '5min_cpu', '2013-02-06 09:25:15', '21')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (130, '5min_cpu', '2013-02-06 09:25:14', '15')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (127, '5min_cpu', '2013-02-06 09:25:14', '3')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (124, '5min_cpu', '2013-02-06 09:25:14', '3')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (121, '5min_cpu', '2013-02-06 09:25:14', '13')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (118, '5min_cpu', '2013-02-06 09:25:14', '4')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (115, '5min_cpu', '2013-02-06 09:25:14', '6')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (112, '5min_cpu', '2013-02-06 09:25:14', '28')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (103, '5min_cpu', '2013-02-06 09:25:13', '9')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (100, '5min_cpu', '2013-02-06 09:25:13', '6')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (97, '5min_cpu', '2013-02-06 09:25:13', '0')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (132, '5min_cpu', '2013-02-06 09:25:13', '7')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (126, '5min_cpu', '2013-02-06 09:25:12', '11')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (123, '5min_cpu', '2013-02-06 09:25:12', '13')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (91, '5min_cpu', '2013-02-06 09:25:12', '0')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (120, '5min_cpu', '2013-02-06 09:25:12', '22')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (85, '5min_cpu', '2013-02-06 09:25:12', '1')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (88, '5min_cpu', '2013-02-06 09:25:12', '11')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (79, '5min_cpu', '2013-02-06 09:25:11', '7')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (76, '5min_cpu', '2013-02-06 09:25:11', '2')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (111, '5min_cpu', '2013-02-06 09:25:11', '59')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (108, '5min_cpu', '2013-02-06 09:25:11', '7')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (105, '5min_cpu', '2013-02-06 09:25:11', '1')'
02/06/2013 09:25:13 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (73, '5min_cpu', '2013-02-06 09:25:11', '9')'
Re: data collection problem
mysql error 1062 is duplicate entry. Do you have two pollers running at once?
| Scripts: Monitor processes | RFC1213 MIB | DOCSIS Stats | Dell PowerEdge | Speedfan | APC UPS | DOCSIS CMTS | 3ware | Motorola Canopy |
| Guides: Windows Install | [HOWTO] Debug Windows NTFS permission problems |
| Tools: Windows All-in-one Installer |
Re: data collection problem
no, i just have one poller.
i have found a new clue.
when i check the log file, i can the the result of the snmp query
i have found a new clue.
when i check the log file, i can the the result of the snmp query
But in rrd file, i have the value nan instead of 802/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] PING: ICMP Ping Success (10.328 ms)
02/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] SNMP: Host responded to SNMP
02/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] RECACHE: Processing 1 items in the auto reindex cache for 'MY DECIVE IP'.
02/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] RECACHE DQ[1] OID: .1.3.6.1.2.1.1.3.0
02/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] RECACHE DQ[1] OID: .1.3.6.1.2.1.1.3.0, output: 1250737865
02/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] DS[130] SNMP: v2: MY DECIVE IP, dsname: 5min_cpu, oid: .1.3.6.1.4.1.9.2.1.58.0, output: 8
02/06/2013 07:00:31 PM - POLLER: Poller[0] CACTI2RRD: /usr/bin/rrdtool update /var/www/html/cacti-0.8.8a/rra/MY DEVICE_5min_cpu_130.rrd --template 5min_cpu 1360170031:8
this is not normal and i cannot find anything about it.<!-- 2013-02-06 19:00:00 EET / 1360170000 -->
<row>
<v>NaN</v>
</row>
Re: data collection problem
Per http://docs.cacti.net/manual:088:4_help.2_debugging does rrdtool fetch <rrd file> AVERAGE show recent data? RRD File Ownership correct?
| Scripts: Monitor processes | RFC1213 MIB | DOCSIS Stats | Dell PowerEdge | Speedfan | APC UPS | DOCSIS CMTS | 3ware | Motorola Canopy |
| Guides: Windows Install | [HOWTO] Debug Windows NTFS permission problems |
| Tools: Windows All-in-one Installer |
Re: data collection problem
it is not about file ownership "i think", because i have also datas in the rrd file (as you can see in the graph).
i dont see any error about snmp polling. there is an error only about writing the data to rrd file.
i dont see any error about snmp polling. there is an error only about writing the data to rrd file.
- gandalf
- Developer
- Posts: 22383
- Joined: Thu Dec 02, 2004 2:46 am
- Location: Muenster, Germany
- Contact:
Re: data collection problem
How did you determine this? /var/log/cron?utkualp wrote:no, i just have one poller.
R.
Re: data collection problem
I ve just configured like below.
in cacti.log file i see all the missing values of the graphs. But that is happening only for some graphs.
As i said my problem is to not be able to write the snmp results to rrd files.in cacti.log file i see all the missing values of the graphs. But that is happening only for some graphs.
Re: data collection problem
ok, new clue regarding to gandalf's last post
i see 2 pollers running same time
Feb 10 00:05:01 Hostname CROND[13576]: (cactiuser) CMD (/usr/bin/php /var/www/html/cacti/poller.php > /dev/null 2>&1)
Feb 10 00:05:01 Hostname CROND[13575]: (root) CMD (/usr/bin/php /var/www/html/cacti/poller.php > /dev/null 2>&1)
but in crontab, i cannot find the poller process for cactiuser
What should i do?
i see 2 pollers running same time
Feb 10 00:05:01 Hostname CROND[13576]: (cactiuser) CMD (/usr/bin/php /var/www/html/cacti/poller.php > /dev/null 2>&1)
Feb 10 00:05:01 Hostname CROND[13575]: (root) CMD (/usr/bin/php /var/www/html/cacti/poller.php > /dev/null 2>&1)
but in crontab, i cannot find the poller process for cactiuser
Code: Select all
[root@Hostname/]# crontab -l
*/5 * * * * /usr/bin/php /var/www/html/cacti/poller.php > /dev/null 2>&1
#15 */6 * * * sh /backup.sh > /dev/null 2>&1
Code: Select all
[cactiuser@Hostname~]$ crontab -l
no crontab for cactiuser
Re: data collection problem
one of the cron job has been removed and it seems the problem is resolved.
thanks for support and suggestions. As a newbie, i've learned a lot from this topic.
Regards
Utku
thanks for support and suggestions. As a newbie, i've learned a lot from this topic.
Regards
Utku
- gandalf
- Developer
- Posts: 22383
- Joined: Thu Dec 02, 2004 2:46 am
- Location: Muenster, Germany
- Contact:
Re: data collection problem
This was crontab of user "cactiuser", correct? Just for the recordutkualp wrote:Code: Select all
[cactiuser@Hostname~]$ crontab -l no crontab for cactiuser
R.
Re: data collection problem
It was like this
Code: Select all
[root@HOSTNAME /]# cat /etc/cron.d/cacti
*/5 * * * * cactiuser /usr/bin/php /var/www/html/cacti/poller.php > /dev/null 2>&1
[root@HOSTNAME /]#
- gandalf
- Developer
- Posts: 22383
- Joined: Thu Dec 02, 2004 2:46 am
- Location: Muenster, Germany
- Contact:
Re: data collection problem
Well, I see. This is just for the record and for the sake of other users hitting this thread
R.
R.
Who is online
Users browsing this forum: No registered users and 2 guests