Spine: Spine Encountered a Segmentation Fault (Spine parent)

[meralias]

One of the previous traces was generated by the free(snmp_oids) call at line 1001 in the poller.c file.

Ok, trying to recreate, I'm now getting a new one:

Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 1114523968 (LWP 2483)]
0x000000305dc6f9ce in malloc_consolidate () from /lib64/libc.so.6
(gdb) bt
#0 0x000000305dc6f9ce in malloc_consolidate () from /lib64/libc.so.6
#1 0x000000305dc713ea in _int_free () from /lib64/libc.so.6
#2 0x000000305dc74c5c in free () from /lib64/libc.so.6
#3 0x0000003a31a3db46 in _sess_read () from /usr/lib64/libnetsnmp.so.10
#4 0x0000003a31a3e5b9 in snmp_sess_read () from /usr/lib64/libnetsnmp.so.10
#5 0x0000003a31a1678c in snmp_sess_synch_response () from /usr/lib64/libnetsnmp.so.10
#6 0x0000000000405c09 in snmp_get_multi (current_host=0xfee7780, snmp_oids=0x1023e8a0, num_oids=10) at snmp.c:521
#7 0x00000000004083a5 in poll_host (host_id=116) at poller.c:778
#8 0x00000000004099a3 in child (arg=<value optimized out>) at poller.c:51
#9 0x000000305e8062f7 in start_thread () from /lib64/libpthread.so.0
#10 0x000000305dcd1b6d in clone () from /lib64/libc.so.6

[meralias]

Noticing this a lot:

*** glibc detected *** /usr/bin/spine: munmap_chunk(): invalid pointer: 0x000000001e93ac30 ***
======= Backtrace: =========
/lib64/libc.so.6(cfree+0x1b6)[0x305dc74d86]
/usr/lib64/libnetsnmp.so.10(netsnmp_transport_free+0x43)[0x3a31a5e453]
/usr/lib64/libnetsnmp.so.10(snmp_sess_close+0xb9)[0x3a31a33ab9]
/usr/bin/spine[0x40877c]
/usr/bin/spine[0x4099a3]
/lib64/libpthread.so.0[0x305e8062f7]
/lib64/libc.so.6(clone+0x6d)[0x305dcd1b6d]

0x40877c == poller.c: 996

poller.c: 996 (snmp_host_cleanup function )
========

/* cleanup memory and prepare for function exit */
if (host_id) {
snmp_host_cleanup(host->snmp_session);
}

[TheWitness]

Tell me, what version of Spine?

TheWitness

[TheWitness]

Change From:

Code: Select all

if (host_id) {
snmp_host_cleanup(host->snmp_session);
}

to

Code: Select all

if (host_id->snmp_session) {
snmp_host_cleanup(host->snmp_session);
}

TheWitness

[TheWitness]

Post findings.

TheWitness

[meralias]

Question - since host_id is defined as an integer, did you mean something like this:

if (host->snmp_session) {
snmp_host_cleanup(host->snmp_session);
}

instead?

[meralias]

I'm running spine-0.8.7c. I think I may have tied it down to polling one certain device type - I disabled polling the one I had added and spine is no longer crashing. I still want to find out the root cause, however, since I will need to monitor a set of these.

I have loaded up a copy of cacti + spine onto a development server and will use that for testing. I'll also be running some packet traces to try and see why it could be different from other 'normal' devices.

[TheWitness]

Lol. Yes. Sorry, It was late when I did it.

TheWitness