data collection problem

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

Post Reply
utkualp
Cacti User
Posts: 67
Joined: Mon Dec 24, 2012 1:10 am

data collection problem

Post by utkualp »

Hi eveyone,

Now i have another problem. I'm using 0.8.8a v of cacti. I've just added all my backbone cisco routers as device. After that created some graphs like CPU or interface in/out bits. But i have interruptions in most of my graphs. One of the example is below. It is the CPU graph one of my backbone routers. You can see that i cannot have any data since ~2 hours.
ank.png
ank.png (12.42 KiB) Viewed 1370 times
But when i try to get the data with snmpwalk, i receive the correct data and do not any any timeout or error from the router
ank2.png
ank2.png (18.42 KiB) Viewed 1370 times
As i said before, i have this problem for more than 80% of my graphs. What might be the problem? Do i have to change the version of cacti i have installed? What would you prefer for troubleshooting?

Regards,
Utku
Top
utkualp
Cacti User
Posts: 67
Joined: Mon Dec 24, 2012 1:10 am

Re: data collection problem

Post by utkualp »

Hi again,

Also i saw the logs below. They might be related with this situation

02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (133, '5min_cpu', '2013-02-06 09:25:15', '21')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (130, '5min_cpu', '2013-02-06 09:25:14', '15')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (127, '5min_cpu', '2013-02-06 09:25:14', '3')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (124, '5min_cpu', '2013-02-06 09:25:14', '3')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (121, '5min_cpu', '2013-02-06 09:25:14', '13')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (118, '5min_cpu', '2013-02-06 09:25:14', '4')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (115, '5min_cpu', '2013-02-06 09:25:14', '6')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (112, '5min_cpu', '2013-02-06 09:25:14', '28')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (103, '5min_cpu', '2013-02-06 09:25:13', '9')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (100, '5min_cpu', '2013-02-06 09:25:13', '6')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (97, '5min_cpu', '2013-02-06 09:25:13', '0')'
02/06/2013 09:25:15 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (132, '5min_cpu', '2013-02-06 09:25:13', '7')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (126, '5min_cpu', '2013-02-06 09:25:12', '11')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (123, '5min_cpu', '2013-02-06 09:25:12', '13')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (91, '5min_cpu', '2013-02-06 09:25:12', '0')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (120, '5min_cpu', '2013-02-06 09:25:12', '22')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (85, '5min_cpu', '2013-02-06 09:25:12', '1')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (88, '5min_cpu', '2013-02-06 09:25:12', '11')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (79, '5min_cpu', '2013-02-06 09:25:11', '7')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (76, '5min_cpu', '2013-02-06 09:25:11', '2')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (111, '5min_cpu', '2013-02-06 09:25:11', '59')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (108, '5min_cpu', '2013-02-06 09:25:11', '7')'
02/06/2013 09:25:14 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (105, '5min_cpu', '2013-02-06 09:25:11', '1')'
02/06/2013 09:25:13 AM - CMDPHP: Poller[0] ERROR: A DB Exec Failed!, Error:'1062', SQL:"insert into poller_output (local_data_id, rrd_name, time, output) values (73, '5min_cpu', '2013-02-06 09:25:11', '9')'
Top
User avatar
BSOD2600
Cacti Moderator
Posts: 12171
Joined: Sat May 08, 2004 12:44 pm
Location: USA

Re: data collection problem

Post by BSOD2600 »

mysql error 1062 is duplicate entry. Do you have two pollers running at once?
Top
utkualp
Cacti User
Posts: 67
Joined: Mon Dec 24, 2012 1:10 am

Re: data collection problem

Post by utkualp »

no, i just have one poller.
i have found a new clue.

when i check the log file, i can the the result of the snmp query
02/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] PING: ICMP Ping Success (10.328 ms)
02/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] SNMP: Host responded to SNMP
02/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] RECACHE: Processing 1 items in the auto reindex cache for 'MY DECIVE IP'.
02/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] RECACHE DQ[1] OID: .1.3.6.1.2.1.1.3.0
02/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] RECACHE DQ[1] OID: .1.3.6.1.2.1.1.3.0, output: 1250737865
02/06/2013 07:00:31 PM - CMDPHP: Poller[0] Host[124] DS[130] SNMP: v2: MY DECIVE IP, dsname: 5min_cpu, oid: .1.3.6.1.4.1.9.2.1.58.0, output: 8
02/06/2013 07:00:31 PM - POLLER: Poller[0] CACTI2RRD: /usr/bin/rrdtool update /var/www/html/cacti-0.8.8a/rra/MY DEVICE_5min_cpu_130.rrd --template 5min_cpu 1360170031:8
But in rrd file, i have the value nan instead of 8
<!-- 2013-02-06 19:00:00 EET / 1360170000 -->
<row>
<v>NaN</v>
</row>
this is not normal and i cannot find anything about it.
Top
User avatar
BSOD2600
Cacti Moderator
Posts: 12171
Joined: Sat May 08, 2004 12:44 pm
Location: USA

Re: data collection problem

Post by BSOD2600 »

Per http://docs.cacti.net/manual:088:4_help.2_debugging does rrdtool fetch <rrd file> AVERAGE show recent data? RRD File Ownership correct?
Top
utkualp
Cacti User
Posts: 67
Joined: Mon Dec 24, 2012 1:10 am

Re: data collection problem

Post by utkualp »

it is not about file ownership "i think", because i have also datas in the rrd file (as you can see in the graph).
i dont see any error about snmp polling. there is an error only about writing the data to rrd file.
Top
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:
Contact gandalf

Re: data collection problem

Post by gandalf »

utkualp wrote:no, i just have one poller.
How did you determine this? /var/log/cron?
R.
Top
utkualp
Cacti User
Posts: 67
Joined: Mon Dec 24, 2012 1:10 am

Re: data collection problem

Post by utkualp »

I ve just configured like below.
A.png
A.png (10.9 KiB) Viewed 1333 times
As i said my problem is to not be able to write the snmp results to rrd files.
in cacti.log file i see all the missing values of the graphs. But that is happening only for some graphs.
B.png
B.png (33.36 KiB) Viewed 1333 times
Top
utkualp
Cacti User
Posts: 67
Joined: Mon Dec 24, 2012 1:10 am

Re: data collection problem

Post by utkualp »

ok, new clue regarding to gandalf's last post
i see 2 pollers running same time

Feb 10 00:05:01 Hostname CROND[13576]: (cactiuser) CMD (/usr/bin/php /var/www/html/cacti/poller.php > /dev/null 2>&1)
Feb 10 00:05:01 Hostname CROND[13575]: (root) CMD (/usr/bin/php /var/www/html/cacti/poller.php > /dev/null 2>&1)

but in crontab, i cannot find the poller process for cactiuser

Code: Select all

[root@Hostname/]# crontab -l
*/5 * * * * /usr/bin/php /var/www/html/cacti/poller.php > /dev/null 2>&1
#15 */6 * * * sh /backup.sh > /dev/null 2>&1

Code: Select all

[cactiuser@Hostname~]$ crontab -l
no crontab for cactiuser
What should i do?
Top
utkualp
Cacti User
Posts: 67
Joined: Mon Dec 24, 2012 1:10 am

Re: data collection problem

Post by utkualp »

one of the cron job has been removed and it seems the problem is resolved.

thanks for support and suggestions. As a newbie, i've learned a lot from this topic.

Regards
Utku
Top
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:
Contact gandalf

Re: data collection problem

Post by gandalf »

utkualp wrote:

Code: Select all

[cactiuser@Hostname~]$ crontab -l
no crontab for cactiuser
This was crontab of user "cactiuser", correct? Just for the record
R.
Top
utkualp
Cacti User
Posts: 67
Joined: Mon Dec 24, 2012 1:10 am

Re: data collection problem

Post by utkualp »

It was like this

Code: Select all

[root@HOSTNAME /]# cat /etc/cron.d/cacti 
*/5 * * * * cactiuser /usr/bin/php /var/www/html/cacti/poller.php > /dev/null 2>&1
[root@HOSTNAME /]#
Top
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:
Contact gandalf

Re: data collection problem

Post by gandalf »

Well, I see. This is just for the record and for the sake of other users hitting this thread
R.
Top
Post Reply

Return to “Help: General”

Who is online

Users browsing this forum: No registered users and 0 guests