gaps in graph

Support questions about the Network Weather Map plugin

Moderators: Developers, Moderators

Post Reply
project09
Posts: 6
Joined: Mon Aug 17, 2009 1:35 am

gaps in graph

Post by project09 »

Hi,
I hope you could help me with my problem. I tried to google it, but no success :(

We have Cacti and Network Weathermap installed (plus Cacti host status) for a year and half, and everything
worked perfect until recently. We replaced Cisco routers 3640 with Juniper J2350
in our network in three locations. One location gathers SNMP data and creates consistent
graphs, but the other two have gaps in graphs and the maximum value on all graphs in 2K.
In some cycles, Weathermap shows 0 on links, and graphs have gaps in those cycles.
In other cycles, weathermap shows max 2K, and graphs show that value.

We have 11 links encountering same problem, and not all 11 are 0 at one poller cycle.

Versions of software:
OS: Win XP SP3 (CPU 2.4GHz, RAM 1.00GB)
WEB: Apache 2.2.8
Cacti: Version 0.8.7b
Spine: Not used
MySQL: 5.0.51b
PHP: 5.2.5
RRDTool: 1.2.x
Net SNMP:
Cygwin:
Plugin Architecture:
Hosts 121
Graphs 426
Data Sources: SNMP: 26
SNMP Query: 203
Script Query - Script Server: 199
Total: 428
Poller Information
Interval 300
Type cmd.php
Items Action[0]: 432
Action[2]: 315
Total: 747
Concurrent Processes 5
Max Threads 1
PHP Servers 1
Script Timeout 25
Max OID 10
Last Run Statistics Time:33.2937 Method:cmd.php Processes:5 Threads:N/A Hosts:122 HostsPerProcess:25 DataSources:747 RRDsProcessed:410

PHP Information
PHP Version 5.2.5
PHP OS WINNT
PHP uname Windows NT WSTKC 5.1 build 2600
PHP SNMP Installed
max_execution_time 300
memory_limit 256M

Messages in Cacti log:
08/17/2009 09:43:53 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: Weathermap 0.95b run complete - 3 maps were run in 18 seconds
08/17/2009 09:43:51 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: Wrote map to C:\mrtg\wwwroot\cacti\plugins\weathermap\output\c7974cb973e3aadfc27c.png and C:\mrtg\wwwroot\cacti\plugins\weathermap\output\c7974cb973e3aadfc27c.thumb.png
08/17/2009 09:43:49 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: About to write image file. If this is the last message in your log, increase memory_limit in php.ini [WMPOLL01]
08/17/2009 09:43:49 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edtravnik-bugojno, target: C:/mrtg/wwwroot/cacti/rra/ed_travnik_j2350_traffic_in_645.rrd on config line 1387 had no valid data, according to WeatherMapDataSource_rrd
08/17/2009 09:43:49 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edtravnik-fojnica, target: C:/mrtg/wwwroot/cacti/rra/ed_travnik_j2350_traffic_in_646.rrd on config line 1379 had no valid data, according to WeatherMapDataSource_rrd
08/17/2009 09:43:48 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edtravnik-gornjivakuf, target: C:/mrtg/wwwroot/cacti/rra/ed_travnik_j2350_traffic_in_648.rrd on config line 1371 had no valid data, according to WeatherMapDataSource_rrd
08/17/2009 09:43:48 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edtravnik-donjivakuf, target: C:/mrtg/wwwroot/cacti/rra/ed_travnik_j2350_traffic_in_650.rrd on config line 1363 had no valid data, according to WeatherMapDataSource_rrd
08/17/2009 09:43:48 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edtravnik-ntravnik, target: C:/mrtg/wwwroot/cacti/rra/ed_travnik_j2350_traffic_in_651.rrd on config line 1355 had no valid data, according to WeatherMapDataSource_rrd
08/17/2009 09:43:48 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edtravnik-vitez, target: C:/mrtg/wwwroot/cacti/rra/ed_travnik_j2350_traffic_in_649.rrd on config line 1347 had no valid data, according to WeatherMapDataSource_rrd
08/17/2009 09:43:45 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edzenica-visoko, target: C:/mrtg/wwwroot/cacti/rra/ed_zenica_j2350_traffic_in_619.rrd on config line 1112 had no valid data, according to WeatherMapDataSource_rrd
08/17/2009 09:43:45 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edzenica-olovo, target: C:/mrtg/wwwroot/cacti/rra/ed_zenica_j2350_traffic_in_620.rrd on config line 1103 had no valid data, according to WeatherMapDataSource_rrd
08/17/2009 09:43:45 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edzenica-zepce, target: C:/mrtg/wwwroot/cacti/rra/ed_zenica_j2350_traffic_in_621.rrd on config line 1094 had no valid data, according to WeatherMapDataSource_rrd
08/17/2009 09:43:40 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: Map: C:\mrtg\wwwroot\cacti\plugins\weathermap\configs\JP EP BiH -> C:\mrtg\wwwroot\cacti\plugins\weathermap\output\c7974cb973e3aadfc27c.html & C:\mrtg\wwwroot\cacti\plugins\weathermap\output\c7974cb973e3aadfc27c.png
: Poller[0] Weathermap 0.95b starting - Normal logging mode. Turn on DEBUG in Cacti for more information
08/17/2009 09:43:35 AM - WEATHERMAP
08/17/2009 09:43:35 AM - SYSTEM STATS: Time:34.7994 Method:cmd.php Processes:5 Threads:N/A Hosts:122 HostsPerProcess:25 DataSources:747 RRDsProcessed:411
What is more interesting is that gaps in the graphs appear only during working hours (from 7:30 to 16:00).
I will try to post some images in next post...
Last edited by project09 on Mon Aug 17, 2009 5:40 am, edited 1 time in total.
Top
project09
Posts: 6
Joined: Mon Aug 17, 2009 1:35 am

Post by project09 »

Routers on the left and on the right are replaced Juniper J2350 routers.

Image

Following image shows traffic graph on one of the links from J2350 router to branch office.

Image
Top
User avatar
Howie
Cacti Guru User
Posts: 5508
Joined: Thu Sep 16, 2004 5:53 am
Location: United Kingdom
Contact:
Contact Howie

Post by Howie »

This isn't a weathermap problem, it's a Cacti problem. If Cacti isn't collecting data, Weathermap can't display it.

The solution is probably to increase the SNMP timeout for the affected devices (try 1500ms). But you will find plenty of threads in the General Help forum about gaps in graphs.
Weathermap 0.98a is out! & QuickTree 1.0. Superlinks is over there now (and built-in to Cacti 1.x).
Some Other Cacti tweaks, including strip-graphs, icons and snmp/netflow stuff.
(Let me know if you have UK DevOps or Network Ops opportunities, too!)
Top
project09
Posts: 6
Joined: Mon Aug 17, 2009 1:35 am

Post by project09 »

Well, the messages in cacti log refered to weathermap and WeatherMapDataSource_rrd , so I posted it here...
I read all I came across considering gaps, holes, breaks in graph but nothing helped, and the problem is not the same. None of those posted issues had max value in graph = 2K, that's weird.

Increasing SNMP timeout didn't help...

I'm desperate, I got used to Cacti and Weathermap :(
Top
User avatar
Howie
Cacti Guru User
Posts: 5508
Joined: Thu Sep 16, 2004 5:53 am
Location: United Kingdom
Contact:
Contact Howie

Post by Howie »

project09 wrote:Well, the messages in cacti log refered to weathermap and WeatherMapDataSource_rrd , so I posted it here...
I read all I came across considering gaps, holes, breaks in graph but nothing helped, and the problem is not the same. None of those posted issues had max value in graph = 2K, that's weird.

Increasing SNMP timeout didn't help...

I'm desperate, I got used to Cacti and Weathermap :(
Then I'd post a 'gaps in graphs' question in the General Help forum... the only reason weathermap is complaining is because there's no data.
Weathermap 0.98a is out! & QuickTree 1.0. Superlinks is over there now (and built-in to Cacti 1.x).
Some Other Cacti tweaks, including strip-graphs, icons and snmp/netflow stuff.
(Let me know if you have UK DevOps or Network Ops opportunities, too!)
Top
User avatar
TheWitness
Developer
Posts: 17061
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Grep out the Weathermap sections of the Cacti.log file and then post back to here the log messages that were occurring at the time of this gappage. Also, if you are using 0.8.7e, turn off "process leveling", if you turned it on (Settings->Poller). There is a known issue with this setting.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
project09
Posts: 6
Joined: Mon Aug 17, 2009 1:35 am

Post by project09 »

TheWitness wrote:Grep out the Weathermap sections of the Cacti.log file and then post back to here the log messages that were occurring at the time of this gappage. Also, if you are using 0.8.7e, turn off "process leveling", if you turned it on (Settings->Poller). There is a known issue with this setting.

TheWitness
I'm using 0.8.7b...

this is weathermap messages in cacti.log (I posted them in first post too)
08/18/2009 07:33:44 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edtravnik-donjivakuf, target: C:/mrtg/wwwroot/cacti/rra/ed_travnik_j2350_traffic_in_650.rrd on config line 1363 had no valid data, according to WeatherMapDataSource_rrd
08/18/2009 07:33:41 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edzenica-visoko, target: C:/mrtg/wwwroot/cacti/rra/ed_zenica_j2350_traffic_in_619.rrd on config line 1112 had no valid data, according to WeatherMapDataSource_rrd
08/18/2009 07:33:41 AM - WEATHERMAP: Poller[0] [Map 1] JPEP: ReadData: LINK edzenica-zepce, target: C:/mrtg/wwwroot/cacti/rra/ed_zenica_j2350_traffic_in_621.rrd on config line 1094 had no valid data, according to WeatherMapDataSource_rrd
Top
User avatar
TheWitness
Developer
Posts: 17061
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:
Contact TheWitness

Post by TheWitness »

Sorry, I wanted them removed so that we can see the errors. Also, I noted in an install yesterday, that RRDtool 1.3.x is crashing on many systems. If you are using that version of RRDtool, backoff to something more stable like 1.2.27.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages

For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Top
project09
Posts: 6
Joined: Mon Aug 17, 2009 1:35 am

Post by project09 »

Sorry, guys. False alarm...
Problem is not with Cacti either. Thank God :D

Now, I'm just gonna write what I've figured out, so that others with the same problem know what to do next (and of course, if I get some answers from Juniper, I'll let you know) :)

The problem is that Juniper routers seem to send incorrect SNMP information about traffic on logical interfaces (that's why there is gaps and max value is 2K in graphs). SNMP information about traffic on physical interfaces are correct. So this is definitely something to report to Juniper :)

Thanks for helping me, anyway!
Top
Post Reply

Return to “Plugin: (Network Weather Map)”

Who is online

Users browsing this forum: No registered users and 2 guests