[partially! SOLVED] - problem snmpv3 authPriv

[didx]

Hum! I was so happy viewing all my graphs growing again I did't test everything! I'm so sad having to report that I can't create any new snmp v3 host... (see 06Jul2009 post...)

======
The "partial" solution was given by theWitness here

======


Hi everyone!

I recently changed my cacti server for perf improvement.
Since then, the snmp v3 polling (MD5+AES) doesn't function anymore.

I captured the SNMP packets with wireshark. I saw that neither the authentication nor the privacy was present in the packet. This is exactly the same as what happens when I do the snmp via the command line without the "-l authPriv" option.

I have put the option in /etc/snmp/snmp.conf file. It does work in command line but doesn't in cacti...

I'm using cmd.php for yet.

Does someone have any idea?

Thanks

[didx]

Hi!

I have tried to use spine instead of cmd.php to see if things were better.
The fact is that I'm using Enterprise Linux Oracle which is quite like a Red Hat EL 5.

I had to create symbolic links to match the default distribution name for 2 libs: libsnmp.so (referenced as libsnmp.so.10.0.3) and libnetsnmp.so (referenced as libnetsnmp.so.10) to achieve spine compilation.

I finally compiled spine and started polling with it ... But I still have the same problems... snmp v3 polling does not work.

Does anyone have an idea?

[gandalf]

Please post an example of your SNMP V3 parameter settings for that host. You may change strings for security reason
Reinhard

[didx]

Thank you for your answer Gandalf,

here is my config and the corresponding cli command that works.

[didx]

furthermore, I can see with a packet capture that for snmp v3 interrogation, the first unauthenticated packet is send by cacti. The switch answers with the EngineID but no authenticated/private packet is send after that.

I'm really confused.

Is there any way to test spine snmp calls whith a single host and debug infos?
Have you any other clue?

thanks

[gandalf]

Is there any way to test spine snmp calls whith a single host and debug infos?

./spine --verbosity=5 <id> <id>
where <id> is the numerical id of the host in question.
I only did some very basic SNMP V3 tests and am quite sure that I did not test the AES case.
Are you using the php-snmp module? If yes, please de-activate it for a test and report results. To be honest, php-snmp has not been documented very good
Reinhard

[didx]

I'm not sure understanding what you mean by de-activating the php-snmp module. Until your last post I thought spine was only using a C snmp API. Am I wrong with that?
Well, I uninstalled the php-snmp rpm for the test.

Here is the result:

Code: Select all

[root@lnxnord02 conf.d]# rpm -e php-snmp --nodeps
[root@lnxnord02 conf.d]# spine --verbosity=5 576 576
SPINE: Using spine config file [/etc/spine.conf]
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The path_php_server variable is /usr/share/cacti/script_server.php
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The path_cactilog variable is /var/log/cacti/cacti.log
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The log_destination variable is 1 (FILE)
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The path_php variable is /usr/bin/php
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The availability_method variable is 2
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The ping_recovery_count variable is 1
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The ping_failure_count variable is 1
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The ping_method variable is 2
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The ping_retries variable is 1
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The ping_timeout variable is 400
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The log_perror variable is 1
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The log_pwarn variable is 1
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The log_pstats variable is 1
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The threads variable is 7
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The polling interval is 300 seconds
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The number of concurrent processes is 8
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The script timeout is 35
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The number of php script servers to run is 5
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: StartHost='576', EndHost='576', TotalPHPScripts='0'
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The PHP Script Server is Not Required
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The Maximum SNMP OID Get Size is 30
06/17/2009 09:33:35 AM - SPINE: Poller[0] Version 0.8.7c starting
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: MySQL is Thread Safe!
06/17/2009 09:33:35 AM - SPINE: Poller[0] SPINE: Initializing Net-SNMP API
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: SNMP Header Version is 5.3.2.2
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: SNMP Library Version is 5.3.2.2
06/17/2009 09:33:35 AM - SPINE: Poller[0] SPINE: Initializing PHP Script Server(s)
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: Initial Value of Active Threads is 0
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
06/17/2009 09:33:35 AM - SPINE: Poller[0] Host[0] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: Valid Thread to be Created
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 2
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: In Poller, About to Start Polling of Host
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 1
06/17/2009 09:33:35 AM - SPINE: Poller[0] Host[576] SNMP Result: Host did not respond to SNMP
06/17/2009 09:33:35 AM - SPINE: Poller[0] Host[576] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: The Value of Active Threads is 0
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: Thread Cleanup Complete
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: PHP Script Server Pipes Closed
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: Allocated Variable Memory Freed
06/17/2009 09:33:35 AM - SPINE: Poller[0] DEBUG: MYSQL Free & Close Completed
06/17/2009 09:33:35 AM - SPINE: Poller[0] Time: 0.0626 s, Threads: 7, Hosts: 2

Nothing looks wrong to me ... but no SNMP response from the host...

[didx]

oulala!

While doing the test,
- configured poller in cacti was cmd.php
- the php-snmp rpm was not installed
when I went back to cacti after the test ... The snmp v3 polling was working!! BUT the v2 polling DID NOT work anymore!!!

furthermore... I turned back to spine ... once again the v2 works and the v3 doesn't!

[gandalf]

Due to lack of time I won't be able to test in the next days.
Are you able to vary your parameters, e.g. checking different options of SNMP V3? I'm quite sure, that this is related to a specific combination only. Those tests will help to narrow the problem down
Reinhard

[didx]

Hi!

Sorry but couldn't find enough time to do the snmp tests yet. I'll try and do them as soon as possible.

I took the time to check with cacti 0.8.7e & spine 0.8.7e but the problem remains.

[didx]

OK I think I spoke too fast... or without enough testing...

Well if I uninstall php-snmp AND I use cmd.php V2 & V3 hosts.
I Think I've tested all other possible configuration and in other cases I only get info from my v2 hosts.

I'll do more tests and post my results! (cause I still have many many switches to put in cacti)

[TheWitness]

Can you provide me your ./configure and make outputs from Spine 0.8.7e? Also, what AES mode are you using? How many bits?

Thanks,

TheWitness

[TheWitness]

Does this one compile?

TheWitness

[didx]

Hi Gandalf!

First of all I want to thank the cacti team for the 0.8.7e release as I can now use my new & fast server!

But few issues remains... I'm still not able to use spine. Due to the number of switches I want to monitor, I'll certainly need it.

As this is the only way it works yet, php-snmp is removed from my server and I'm using cmd.php.

Here is the configure script output:

Code: Select all

checking build system type... i686-redhat-linux-gnu
checking host system type... i686-redhat-linux-gnu
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... /bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking for gawk... (cached) gawk
checking for gcc... gcc
checking for C compiler default output file name... a.out
checking whether the C compiler works... yes
checking whether we are cross compiling... no
checking for suffix of executables...
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking for style of include used by make... GNU
checking dependency style of gcc... gcc3
checking how to run the C preprocessor... gcc -E
checking for a BSD-compatible install... /usr/bin/install -c
checking whether ln -s works... yes
checking for a sed that does not truncate output... /bin/sed
checking for grep that handles long lines and -e... /bin/grep
checking for egrep... /bin/grep -E
checking for ld used by gcc... /usr/bin/ld
checking if the linker (/usr/bin/ld) is GNU ld... yes
checking for /usr/bin/ld option to reload object files... -r
checking for BSD-compatible nm... /usr/bin/nm -B
checking how to recognize dependent libraries... pass_all
checking for ANSI C header files... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking dlfcn.h usability... yes
checking dlfcn.h presence... yes
checking for dlfcn.h... yes
checking for g++... g++
checking whether we are using the GNU C++ compiler... yes
checking whether g++ accepts -g... yes
checking dependency style of g++... gcc3
checking how to run the C++ preprocessor... g++ -E
checking for g77... g77
checking whether we are using the GNU Fortran 77 compiler... yes
checking whether g77 accepts -g... yes
checking the maximum length of command line arguments... 98304
checking command to parse /usr/bin/nm -B output from gcc object... ok
checking for objdir... .libs
checking for ar... ar
checking for ranlib... ranlib
checking for strip... strip
checking if gcc supports -fno-rtti -fno-exceptions... no
checking for gcc option to produce PIC... -fPIC
checking if gcc PIC flag -fPIC works... yes
checking if gcc static flag -static works... yes
checking if gcc supports -c -o file.o... yes
checking whether the gcc linker (/usr/bin/ld) supports shared libraries... yes
checking whether -lc should be explicitly linked in... no
checking dynamic linker characteristics... GNU/Linux ld.so
checking how to hardcode library paths into programs... immediate
checking whether stripping libraries is possible... yes
checking if libtool supports shared libraries... yes
checking whether to build shared libraries... yes
checking whether to build static libraries... yes
configure: creating libtool
appending configuration tag "CXX" to libtool
checking for ld used by g++... /usr/bin/ld
checking if the linker (/usr/bin/ld) is GNU ld... yes
checking whether the g++ linker (/usr/bin/ld) supports shared libraries... yes
checking for g++ option to produce PIC... -fPIC
checking if g++ PIC flag -fPIC works... yes
checking if g++ static flag -static works... yes
checking if g++ supports -c -o file.o... yes
checking whether the g++ linker (/usr/bin/ld) supports shared libraries... yes
checking dynamic linker characteristics... GNU/Linux ld.so
(cached) (cached) checking how to hardcode library paths into programs... immediate
appending configuration tag "F77" to libtool
checking if libtool supports shared libraries... yes
checking whether to build shared libraries... yes
checking whether to build static libraries... yes
checking for g77 option to produce PIC... -fPIC
checking if g77 PIC flag -fPIC works... yes
checking if g77 static flag -static works... yes
checking if g77 supports -c -o file.o... yes
checking whether the g77 linker (/usr/bin/ld) supports shared libraries... yes
checking dynamic linker characteristics... GNU/Linux ld.so
(cached) (cached) checking how to hardcode library paths into programs... immediate
checking for ranlib... (cached) ranlib
checking whether to enable -Wall... no
checking for threadsafe gethostbyname()... no
checking for gethostbyname_r in -lnls... no
checking for socket in -lsocket... no
checking for floor in -lm... yes
checking for pthread_exit in -lpthread... yes
checking for deflate in -lz... yes
checking for kstat_close in -lkstat... no
checking for CRYPTO_realloc in -lcrypto... yes
checking for ANSI C header files... (cached) yes
checking sys/socket.h usability... yes
checking sys/socket.h presence... yes
checking for sys/socket.h... yes
checking sys/select.h usability... yes
checking sys/select.h presence... yes
checking for sys/select.h... yes
checking sys/wait.h usability... yes
checking sys/wait.h presence... yes
checking for sys/wait.h... yes
checking sys/time.h usability... yes
checking sys/time.h presence... yes
checking for sys/time.h... yes
checking assert.h usability... yes
checking assert.h presence... yes
checking for assert.h... yes
checking ctype.h usability... yes
checking ctype.h presence... yes
checking for ctype.h... yes
checking errno.h usability... yes
checking errno.h presence... yes
checking for errno.h... yes
checking signal.h usability... yes
checking signal.h presence... yes
checking for signal.h... yes
checking math.h usability... yes
checking math.h presence... yes
checking for math.h... yes
checking malloc.h usability... yes
checking malloc.h presence... yes
checking for malloc.h... yes
checking netdb.h usability... yes
checking netdb.h presence... yes
checking for netdb.h... yes
checking for signal.h... (cached) yes
checking stdarg.h usability... yes
checking stdarg.h presence... yes
checking for stdarg.h... yes
checking stdio.h usability... yes
checking stdio.h presence... yes
checking for stdio.h... yes
checking syslog.h usability... yes
checking syslog.h presence... yes
checking for syslog.h... yes
checking for netinet/in_systm.h... yes
checking for netinet/in.h... yes
checking for netinet/ip.h... yes
checking for netinet/ip_icmp.h... yes
checking for unsigned long long... yes
checking for long long... yes
checking for an ANSI C-conforming const... yes
checking for size_t... yes
checking whether time.h and sys/time.h may both be included... yes
checking whether struct tm is in sys/time.h or time.h... time.h
checking return type of signal handlers... void
checking for malloc... yes
checking for calloc... yes
checking for gettimeofday... yes
checking for strerror... yes
checking for strtoll... yes
checking priv.h usability... no
checking priv.h presence... no
checking for priv.h... no
checking whether we are using Solaris privileges... no
checking for mysql_init in -lmysqlclient_r... yes
checking for mysql_thread_init in -lmysqlclient_r... yes
checking if UCD-SNMP needs crypto support... no
checking if Net-SNMP needs crypto support... yes
checking for snmp_timeout in -lnetsnmp... yes
checking for the spine results buffer size... 1024 bytes
checking for the maximum simultaneous spine scripts... 20
checking for the maximum MySQL buffer size... 65536
checking whether we are using traditional popen... no
checking for glibc gethostbyname_r... yes
checking for Solaris/Irix gethostbyname_r... no
checking for HP-UX gethostbyname_r... no
configure: creating ./config.status
config.status: creating Makefile
config.status: creating config/config.h
config.status: config/config.h is unchanged
config.status: executing depfiles commands

Here is the make output (I did a make clean before) with the original snmp.c file:

Code: Select all

gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT sql.o -MD -MP -MF .deps/sql.Tpo -c -o sql.o sql.c
mv -f .deps/sql.Tpo .deps/sql.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT spine.o -MD -MP -MF .deps/spine.Tpo -c -o spine.o spine.c
mv -f .deps/spine.Tpo .deps/spine.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c
mv -f .deps/util.Tpo .deps/util.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT snmp.o -MD -MP -MF .deps/snmp.Tpo -c -o snmp.o snmp.c
mv -f .deps/snmp.Tpo .deps/snmp.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT locks.o -MD -MP -MF .deps/locks.Tpo -c -o locks.o locks.c
mv -f .deps/locks.Tpo .deps/locks.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT poller.o -MD -MP -MF .deps/poller.Tpo -c -o poller.o poller.c
mv -f .deps/poller.Tpo .deps/poller.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT nft_popen.o -MD -MP -MF .deps/nft_popen.Tpo -c -o nft_popen.o nft_popen.c
mv -f .deps/nft_popen.Tpo .deps/nft_popen.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT php.o -MD -MP -MF .deps/php.Tpo -c -o php.o php.c
mv -f .deps/php.Tpo .deps/php.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT ping.o -MD -MP -MF .deps/ping.Tpo -c -o ping.o ping.c
mv -f .deps/ping.Tpo .deps/ping.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT keywords.o -MD -MP -MF .deps/keywords.Tpo -c -o keywords.o keywords.c
mv -f .deps/keywords.Tpo .deps/keywords.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT error.o -MD -MP -MF .deps/error.Tpo -c -o error.o error.c
mv -f .deps/error.Tpo .deps/error.Po
/bin/sh ./libtool --tag=CC   --mode=link gcc  -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2  -L/usr/lib -L/usr/lib/mysql  -o spine sql.o spine.o util.o snmp.o locks.o poller.o nft_popen.o php.o ping.o keywords.o error.o  -lnetsnmp -lmysqlclient_r -lmysqlclient_r -lcrypto -lz -lpthread -lm
mkdir .libs
gcc -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -o spine sql.o spine.o util.o snmp.o locks.o poller.o nft_popen.o php.o ping.o keywords.o error.o  -L/usr/lib -L/usr/lib/mysql -lnetsnmp -lmysqlclient_r -lcrypto -lz -lpthread -lm

...And the same with the snmp.c you sent in your previous message:

Code: Select all

gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT sql.o -MD -MP -MF .deps/sql.Tpo -c -o sql.o sql.c
mv -f .deps/sql.Tpo .deps/sql.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT spine.o -MD -MP -MF .deps/spine.Tpo -c -o spine.o spine.c
mv -f .deps/spine.Tpo .deps/spine.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c
mv -f .deps/util.Tpo .deps/util.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT snmp.o -MD -MP -MF .deps/snmp.Tpo -c -o snmp.o snmp.c
mv -f .deps/snmp.Tpo .deps/snmp.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT locks.o -MD -MP -MF .deps/locks.Tpo -c -o locks.o locks.c
mv -f .deps/locks.Tpo .deps/locks.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT poller.o -MD -MP -MF .deps/poller.Tpo -c -o poller.o poller.c
mv -f .deps/poller.Tpo .deps/poller.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT nft_popen.o -MD -MP -MF .deps/nft_popen.Tpo -c -o nft_popen.o nft_popen.c
mv -f .deps/nft_popen.Tpo .deps/nft_popen.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT php.o -MD -MP -MF .deps/php.Tpo -c -o php.o php.c
mv -f .deps/php.Tpo .deps/php.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT ping.o -MD -MP -MF .deps/ping.Tpo -c -o ping.o ping.c
mv -f .deps/ping.Tpo .deps/ping.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT keywords.o -MD -MP -MF .deps/keywords.Tpo -c -o keywords.o keywords.c
mv -f .deps/keywords.Tpo .deps/keywords.Po
gcc -DHAVE_CONFIG_H -I. -I./config     -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -MT error.o -MD -MP -MF .deps/error.Tpo -c -o error.o error.c
mv -f .deps/error.Tpo .deps/error.Po
/bin/sh ./libtool --tag=CC   --mode=link gcc  -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2  -L/usr/lib -L/usr/lib/mysql  -o spine sql.o spine.o util.o snmp.o locks.o poller.o nft_popen.o php.o ping.o keywords.o error.o  -lnetsnmp -lmysqlclient_r -lmysqlclient_r -lcrypto -lz -lpthread -lm
mkdir .libs
gcc -I/usr/include/net-snmp -I/usr/include/net-snmp/.. -I/usr/include/mysql -g -O2 -o spine sql.o spine.o util.o snmp.o locks.o poller.o nft_popen.o php.o ping.o keywords.o error.o  -L/usr/lib -L/usr/lib/mysql -lnetsnmp -lmysqlclient_r -lcrypto -lz -lpthread -lm

About AES, I'm using AES128 on Nortel switches.

[TheWitness]

So, the new spine made no difference?

TheWitness