Strange problem adding some new devices

[murawai]

Hi

I have set up cacti and added approximately 15 Cisco Routers which we are polling and drawing graphs for OK.

I have strange problem that on 5 or 6 routers when I try and add the device it seems like it times out or something when trying to do the initial snmp get. The page doesn't come back and hangs at http://10.140.11.19/host.php. When I go back and look at devices the device I tried to add is there however when I try to look at the interfaces to add a graph the full info isn't available (ie port speeds/comments etc).

Happens consistantly on these group of routers even though their IOS and configs are basically identical to one which work OK.

Any one seen this before?

[TheWitness]

look at timeout values and in addition, look to server load and MySQL connections in use.

TheWitness

[murawai]

I have re-created my mysql database and started again - and I still get this error (even when its my first object). It doesn't seem to care about the snmp timeout value...even if i set to something large.

[TheWitness]

My next suspicion is PHP. Run "php -v" and "php -m" from the command line and post the output.

TheWitness

[murawai]

D:\>php -v
PHP 5.0.4 (cli) (built: Mar 31 2005 02:45:48)
Copyright (c) 1997-2004 The PHP Group
Zend Engine v2.0.4-dev, Copyright (c) 1998-2004 Zend Technologies

D:\>php -m
[PHP Modules]
bcmath
calendar
com_dotnet
ctype
dom
ftp
iconv
libxml
mysql
odbc
pcre
session
SimpleXML
snmp
sockets
SPL
SQLite
standard
tokenizer
wddx
xml
zlib

[Zend Modules]

[murawai]

Some more description that may help descibe whats happening.

Even though these 5 devices timeout when I try and create them, I can still see them when I go back and click on the devices list.
When I select one to look at its details I notice that there are no associated graph templates. (I can add the cpu one manually even though I don't graph these).
When I go to try and create a graph for these host the interface list look complete however the only fields are
Index
Status
Description
Name (IF-MIB)
Alias (IF-MIB) ---- this one appears in some of the devices

Trying to refresh this data by clicking on the green circle also timesout or freese...ie page remains blank and stops.

If I try and draw any graphs using the incompete fields above - they don't work and title ends up looking like this - Singapore Asia Router - Traffic - |query_ifName|

[TheWitness]

Open a shell and run the following command to one of the hosts:

ping -l 1400 -t <IPAddress>

Does it come back clean? (aka No packet loss) You may have bad cabling. If it does come back clean, install net-snmp and run the following from the command line.

snmpwalk -c <your_community> -v <your_version> <your_hostname>

See what comes back.

TheWitness

[murawai]

Hi

Ping is clean - no packet loss. When I do the snmpwalk I get heaps of info comming back. Seems successful.
I have added some of the data returned below.

D:\>ping -l 1400 -t ap-sinasiartr001

Pinging ap-sinasiartr001.aap.pwcinternal.com [10.169.169.70] with 1400 bytes of
data:

Reply from 10.169.169.70: bytes=1400 time=124ms TTL=252
Reply from 10.169.169.70: bytes=1400 time=124ms TTL=252
Reply from 10.169.169.70: bytes=1400 time=126ms TTL=252
Reply from 10.169.169.70: bytes=1400 time=127ms TTL=252
Reply from 10.169.169.70: bytes=1400 time=160ms TTL=252
Reply from 10.169.169.70: bytes=1400 time=123ms TTL=252

Ping statistics for 10.169.169.70:
Packets: Sent = 6, Received = 6, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 123ms, Maximum = 160ms, Average = 130ms
Control-C
^C
D:\>snmpwalk -c <ourstring> -v 2c ap-sinasiartr001
SNMPv2-MIB::sysDescr.0 = STRING: Cisco Internetwork Operating System Software
IOS (tm) C2600 Software (C2600-I-M), Version 12.3(9a), RELEASE SOFTWARE (fc4)
Copyright (c) 1986-2004 by cisco Systems, Inc.
Compiled Fri 23-Jul-04 01:09 by kellythw
SNMPv2-MIB::sysObjectID.0 = OID: SNMPv2-SMI::enterprises.9.1.209
DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (1388284294) 160 days, 16:20:42
.94
SNMPv2-MIB::sysContact.0 = STRING: <our info>
SNMPv2-MIB::sysName.0 = STRING: ap-sinasiartr001
SNMPv2-MIB::sysLocation.0 = STRING: <our info>
SNMPv2-MIB::sysServices.0 = INTEGER: 78
SNMPv2-MIB::sysORLastChange.0 = Timeticks: (0) 0:00:00.00
IF-MIB::ifNumber.0 = INTEGER: 35
IF-MIB::ifIndex.1 = INTEGER: 1
IF-MIB::ifIndex.2 = INTEGER: 2
IF-MIB::ifIndex.3 = INTEGER: 3
IF-MIB::ifIndex.4 = INTEGER: 4
IF-MIB::ifIndex.5 = INTEGER: 5
IF-MIB::ifIndex.6 = INTEGER: 6
IF-MIB::ifIndex.7 = INTEGER: 7
IF-MIB::ifIndex.8 = INTEGER: 8
IF-MIB::ifIndex.9 = INTEGER: 9
IF-MIB::ifIndex.10 = INTEGER: 10
IF-MIB::ifIndex.11 = INTEGER: 11
IF-MIB::ifIndex.12 = INTEGER: 12
IF-MIB::ifIndex.13 = INTEGER: 13
IF-MIB::ifIndex.14 = INTEGER: 14
IF-MIB::ifIndex.15 = INTEGER: 15
IF-MIB::ifIndex.16 = INTEGER: 16
IF-MIB::ifIndex.17 = INTEGER: 17
IF-MIB::ifIndex.20 = INTEGER: 20
IF-MIB::ifIndex.21 = INTEGER: 21
IF-MIB::ifIndex.22 = INTEGER: 22
IF-MIB::ifIndex.23 = INTEGER: 23
IF-MIB::ifIndex.24 = INTEGER: 24
IF-MIB::ifIndex.25 = INTEGER: 25
IF-MIB::ifIndex.26 = INTEGER: 26
IF-MIB::ifIndex.27 = INTEGER: 27
IF-MIB::ifIndex.28 = INTEGER: 28
IF-MIB::ifIndex.29 = INTEGER: 29
IF-MIB::ifIndex.30 = INTEGER: 30
IF-MIB::ifIndex.31 = INTEGER: 31
IF-MIB::ifIndex.32 = INTEGER: 32
IF-MIB::ifIndex.33 = INTEGER: 33
IF-MIB::ifIndex.34 = INTEGER: 34
IF-MIB::ifIndex.35 = INTEGER: 35
IF-MIB::ifIndex.36 = INTEGER: 36
IF-MIB::ifIndex.37 = INTEGER: 37
IF-MIB::ifDescr.1 = STRING: FastEthernet0/0
IF-MIB::ifDescr.2 = STRING: Serial0/0
IF-MIB::ifDescr.3 = STRING: FastEthernet0/1
IF-MIB::ifDescr.4 = STRING: Serial0/1
IF-MIB::ifDescr.5 = STRING: BRI1/0
IF-MIB::ifDescr.6 = STRING: BRI1/0:1
IF-MIB::ifDescr.7 = STRING: BRI1/0:2
IF-MIB::ifDescr.8 = STRING: BRI1/1
IF-MIB::ifDescr.9 = STRING: BRI1/1:1
IF-MIB::ifDescr.10 = STRING: BRI1/1:2
IF-MIB::ifDescr.11 = STRING: BRI1/2
IF-MIB::ifDescr.12 = STRING: BRI1/2:1
IF-MIB::ifDescr.13 = STRING: BRI1/2:2
IF-MIB::ifDescr.14 = STRING: BRI1/3
IF-MIB::ifDescr.15 = STRING: BRI1/3:1
IF-MIB::ifDescr.16 = STRING: BRI1/3:2
IF-MIB::ifDescr.17 = STRING: Null0
IF-MIB::ifDescr.20 = STRING: Loopback0
IF-MIB::ifDescr.21 = STRING: Dialer1
IF-MIB::ifDescr.22 = STRING: BRI1/0-Physical
IF-MIB::ifDescr.23 = STRING: BRI1/0-Signaling
IF-MIB::ifDescr.24 = STRING: BRI1/0:1-Bearer Channel..

This goes on for a long time returning data - I can add anything else if required.

[TheWitness]

Can we do this online (AIM, MSM???)

TheWitness

[murawai]

AIM - name:murawaibondi

[murawai]

Seems to be the same when using apache.

[murawai]

I can graph the CPU usage on these "problem routers" OK. Its just the interface info that doesn't seem to be gathered correctly. Routers are running same IOS as others which are graphing succesfully. Have tried installing older versions of cacti (back to 0.8.5) however same problem happnes. Not sure what else to try except perhaps change the OS to linux....

[murawai]

Could this discussion be related to my issues

http://forums.cacti.net/about1680.html&highlight=index

my routers with this issue have either ATM interfaces or ISDN Bri interfaces...(although I can successfully poll other routers with BRI's).

I don't really understand the work around by turning down the Maximum JavaScript Rows....whats a good value (96 is default)?

[murawai]

I have fixed this issue. I read the above link more closely and noticed the Witness suggested "Try increasing the timeout (aka MaxExecutionTime) in php.ini and rework". I increased this value from 30 to 60 and it has fully resolved my issues.
I would like to thank The Witness for his assistance last week.