Cacti 0.8.7 cmd.php to spine, several hosts show down.

nvetro · Post by **nvetro** » Sat Mar 01, 2008 9:34 am

ok I do not know how to specificly tell ./spine to poll a specific datasource, I see how to so a --first and --last host but no specific datasources.......

Also, I tried to do it a harder way by removing all graphs/data sources besides the interface traffic data source, I ran the poller.php from the cli with --force --debug and I did not get a timeout on that host/datasource GO FIGURE

So to make a long story short...i enabled about 15 hosts...ran the poller and was getting errors on Host[11] DS[160] which though is a different host, is still the interface traffic data source....I ran the poller several times to make sure that host kept complaining about that data source, here is the cacti log:

Code: Select all

03/01/2008 09:20:18 AM - SPINE: Poller[0] Host[11] DS[160] WARNING: SNMP timeout detected [2000 ms], ignoring host '192.168.71.32'

I ran snoop like you asked but with the -o option is was outputing raw code to the snoop.dmp file, the raw code that corrupts you're vi session in secureCRT and makes you make a new connection

So I ran the poller and issues the following command:

Code: Select all

snoop -r -v  host 192.168.71.32 > snoop.dmp

The above is a snoop agianst Host[11] here is the snoop.dmp file your requested, this should be exactly what you need....This snoop.ttx file has info somewhere about the datasource snmp timeout as I made sure it happened during this snoop. Make sure you open it with TextPad or something similiar as Notepad just shows jibberish

Side Note:

You are going to see this in the snoop.txt file, i assume its my Host Detection method in cacti, even when I use the default port of 23 on UDP it still shows the not reachable, i assume this is correct as it has to ping a port that the server isn't listneing on.

Code: Select all

ICMP:  ----- ICMP Header -----
ICMP:  
ICMP:  Type = 3 (Destination unreachable)
ICMP:  Code = 3 (UDP port 1023 unreachable)
ICMP:  Checksum = 7e37

Post by **TheWitness** » Sat Mar 01, 2008 8:02 pm

Ok, all, make sure, in this case that your availability is set to SNMP only for the host in question. Also, run spine using the following option:

./spine -f <host_id> -l <host_id>

Run a wireshark capture during the poll and send me the output from the wireshark capture.

Without wireshark, I can not help anyone. Sorry, been away.

TheWitness

nvetro · Post by **nvetro** » Sun Mar 02, 2008 9:37 am

My current host aval. option is set to SNMP + Ping (UDP) at the moment....I would rather not install wirehark on this machine as it requires A LOT of depensensies that we do not install on our prod. systems. Won't wirehark give the same information as snoop above?

Post by **TheWitness** » Sun Mar 02, 2008 10:54 am

Not a problem. Now, the UDP ping relies on the error message that you show in your snoop. So, that is pretty much expected. Can you please try and use the spine that is currently in SVN? Please insure that you use "autoreconf" prior to "configure".

What about tcpdump. Do you have access to it?

TheWitness

nvetro · Post by **nvetro** » Sun Mar 02, 2008 10:30 pm

TheWitness: I actually tried the SVN spine, the above is actually from the SVNSpine, I downloaded it this past Friday from:

http://svn.cacti.net/cgi-bin/viewvc.cgi ... hes/0.8.7/

Is this the correct SVN? Or did I need the one from:

http://svn.cacti.net/cgi-bin/viewvc.cgi ... ches/main/

ALSO, I followed the normal directions from the documentation site on how to compile spine, it said to use 'autoconf' never used 'autoreconf' what is the difference, does it matter? I used the following:

Code: Select all

aclocal
libtoolize --force
autoheader
autoconf
automake
./configure --prefix=<location> --with-mysql=<location> --with-snmp=<location>
make 
make install

good? Let me know, thanks!

frankfegert · Post by **frankfegert** » Mon Mar 03, 2008 6:32 am

nvetro wrote:My current host aval. option is set to SNMP + Ping (UDP) at the moment....I would rather not install wirehark on this machine as it requires A LOT of depensensies that we do not install on our prod. systems. Won't wirehark give the same information as snoop above?

*argl* That is exactly why i asked you to use the '-o' option with snoop! You are NOT supposed to open the dump file with an editor, but with an analyzer like wireshark! Wireshark CAN read and interpret the snoop output files! So again: PLEASE run the snoop command i asked for and post the dump file WITHOUT messing it up by using an editor on it!

nvetro · Post by **nvetro** » Mon Mar 03, 2008 8:57 am

frankfegert, sorry about that, didn't know thats what the -o flag was used for...attached is snoopdmp.txt exactly the way you want it...I cannot attach snoop.dmb to the thread as it does not allow that file extension....Thanks for you're help so far

Post by **TheWitness** » Mon Mar 03, 2008 9:03 am

Ok, I just made a new commit, as well as several over the weekend. You need to pull a new copy. I found an issue, on 64bit OS' that causes a segmentation fault. It's related to gettimeofday() function and the ICMP header.

For now, the information that it stores in the packet is not crucial. So, please test again.

TheWitness

nvetro · Post by **nvetro** » Mon Mar 03, 2008 9:40 am

Thewitness, what is the install process using an SVN version of spine? Same as normal?

Post by **TheWitness** » Mon Mar 03, 2008 10:00 am

Yes, make sure you run:

libtoolize --force
autoreconf
./configure

TheWitness

nvetro · Post by **nvetro** » Mon Mar 03, 2008 10:04 am

I did the following:

aclocal
libtoolize --force
autoheader
autoreconfig
automake
./configure --prefix=<location> --with-mysql=<location> --with-snmp=<location>

I switched to that poller and it works but in debug im getting these errors on the CLI, i think it's busted:

Code: Select all

# /data/apps/php/bin/php /data/www/cacti/poller.php --force --debug
No log handling enabled - turning on stderr logging
no such security service available: 3
snmp_build: unknown failureNo log handling enabled - turning on stderr logging
no such security service available: 3
snmp_build: unknown failure03/03/2008 09:59:59 AM - SPINE: Poller[0] Host[31] DS[416] WARNING: SNMP timeout detected [2000 ms], ignoring host '192.168.70.91'
no such security service available: 3
snmp_build: unknown failure03/03/2008 10:00:00 AM - SPINE: Poller[0] Host[31] DS[416] WARNING: SNMP timeout detected [2000 ms], ignoring host '192.168.70.91'
OK u:0.00 s:0.00 r:2.01
no such security service available: 3
snmp_build: unknown failure03/03/2008 10:00:01 AM - SPINE: Poller[0] Host[14] DS[213] WARNING: SNMP timeout detected [2000 ms], ignoring host '192.168.71.51'
no such security service available: 3
snmp_build: unknown failure03/03/2008 10:00:01 AM - SPINE: Poller[0] Host[14] DS[213] WARNING: SNMP timeout detected [2000 ms], ignoring host '192.168.71.51'

ALSO, that snoopdmp.txt file i uploaded to the thread above works in wireshark/ethereal, just tried it.

Post by **TheWitness** » Mon Mar 03, 2008 10:35 am

no such security service available: 3

Interesting, are you using snmpv3?

TheWitness

nvetro · Post by **nvetro** » Mon Mar 03, 2008 10:35 am

frankfegert · Post by **frankfegert** » Mon Mar 03, 2008 10:39 am

nvetro wrote:frankfegert, sorry about that, didn't know thats what the -o flag was used for...attached is snoopdmp.txt exactly the way you want it...I cannot attach snoop.dmb to the thread as it does not allow that file extension....Thanks for you're help so far

Ok, looks good so far. Just to make sure i got it right: You ran the snoop on your cacti machine, which is a Solaris 10 based system, right? The zero UDP header checksums are most likely due to hardware checksum off-loading.

What's kind of odd is, that there are only SNMP answers containing disk statistics.

Post by **TheWitness** » Mon Mar 03, 2008 10:57 am

Ok, grab the latest snmp.c from SVN and see if the warnings go away. I have to do more research on this, but could potentially clean things up.

TheWitness

Cacti 0.8.7 cmd.php to spine, several hosts show down.

Who is online