Page 1 of 1

NagiosXI 5.2.9 Issue with Monitoring Engine Startup

Posted: Fri Sep 30, 2016 7:50 am
by jpc2000
Hi, I've got an issue with the nagiosxi 5.2.9 monitoring engine not starting up.

Config checked and verified - serveral warnings but no errors.

Running centos 6.7 - 8 CPU, 32GB Ram, nothing has been installed or updated for 2 months and has been working fine - today we've experienced this issue and cannot resolve it.

When running the engine in foreground the following is posted to the console:

Code: Select all

Successfully launched command file worker with pid 5836
*** glibc detected *** /usr/local/nagios/bin/nagios: corrupted double-linked list: 0x000000000407cb20 ***
======= Backtrace: =========
/lib64/libc.so.6[0x339e675f4e]
/lib64/libc.so.6[0x339e678fd6]
/usr/lib64/mod_gearman2/mod_gearman2.o(add_job_to_queue+0x46f)[0x7f4f345182d6]
/usr/lib64/mod_gearman2/mod_gearman2.o(add_job_to_queue+0x430)[0x7f4f34518297]
/usr/lib64/mod_gearman2/mod_gearman2.o(+0x1070c)[0x7f4f3452070c]
/usr/local/nagios/bin/nagios(neb_make_callbacks+0xa7)[0x415fe7]
/usr/local/nagios/bin/nagios(broker_service_check+0x27a)[0x41558a]
/usr/local/nagios/bin/nagios(run_async_service_check+0x181)[0x41dbc1]
/usr/local/nagios/bin/nagios(run_scheduled_service_check+0xc0)[0x41e190]
/usr/local/nagios/bin/nagios(handle_timed_event+0x1bf)[0x42dadf]
/usr/local/nagios/bin/nagios(event_execution_loop+0x2e3)[0x430c63]
/usr/local/nagios/bin/nagios(main+0xbb2)[0x413a82]
/lib64/libc.so.6(__libc_start_main+0xfd)[0x339e61ed5d]
/usr/local/nagios/bin/nagios[0x412b89]
======= Memory map: ========
00400000-004a2000 r-xp 00000000 fd:04 524295                             /usr/local/nagios/bin/nagios
006a2000-006a5000 rw-p 000a2000 fd:04 524295                             /usr/local/nagios/bin/nagios
006a5000-006aa000 rw-p 00000000 00:00 0
0178a000-0409d000 rw-p 00000000 00:00 0                                  [heap]
339e200000-339e220000 r-xp 00000000 fd:00 1275                           /lib64/ld-2.12.so
339e41f000-339e420000 r--p 0001f000 fd:00 1275                           /lib64/ld-2.12.so
339e420000-339e421000 rw-p 00020000 fd:00 1275                           /lib64/ld-2.12.so
339e421000-339e422000 rw-p 00000000 00:00 0
339e600000-339e78a000 r-xp 00000000 fd:00 1276                           /lib64/libc-2.12.so
339e78a000-339e98a000 ---p 0018a000 fd:00 1276                           /lib64/libc-2.12.so
339e98a000-339e98e000 r--p 0018a000 fd:00 1276                           /lib64/libc-2.12.so
339e98e000-339e98f000 rw-p 0018e000 fd:00 1276                           /lib64/libc-2.12.so
339e98f000-339e994000 rw-p 00000000 00:00 0
339ea00000-339ea02000 r-xp 00000000 fd:00 4498                           /lib64/libdl-2.12.so
339ea02000-339ec02000 ---p 00002000 fd:00 4498                           /lib64/libdl-2.12.so
339ec02000-339ec03000 r--p 00002000 fd:00 4498                           /lib64/libdl-2.12.so
339ec03000-339ec04000 rw-p 00003000 fd:00 4498                           /lib64/libdl-2.12.so
339ee00000-339ee17000 r-xp 00000000 fd:00 1281                           /lib64/libpthread-2.12.so
339ee17000-339f017000 ---p 00017000 fd:00 1281                           /lib64/libpthread-2.12.so
339f017000-339f018000 r--p 00017000 fd:00 1281                           /lib64/libpthread-2.12.so
339f018000-339f019000 rw-p 00018000 fd:00 1281                           /lib64/libpthread-2.12.so
339f019000-339f01d000 rw-p 00000000 00:00 0
339f600000-339f607000 r-xp 00000000 fd:00 9966                           /lib64/librt-2.12.so
339f607000-339f806000 ---p 00007000 fd:00 9966                           /lib64/librt-2.12.so
339f806000-339f807000 r--p 00006000 fd:00 9966                           /lib64/librt-2.12.so
339f807000-339f808000 rw-p 00007000 fd:00 9966                           /lib64/librt-2.12.so
339fa00000-339fa83000 r-xp 00000000 fd:00 19527                          /lib64/libm-2.12.so
339fa83000-339fc82000 ---p 00083000 fd:00 19527                          /lib64/libm-2.12.so
339fc82000-339fc83000 r--p 00082000 fd:00 19527                          /lib64/libm-2.12.so
339fc83000-339fc84000 rw-p 00083000 fd:00 19527                          /lib64/libm-2.12.so
33a0600000-33a0616000 r-xp 00000000 fd:00 4816                           /lib64/libresolv-2.12.so
33a0616000-33a0816000 ---p 00016000 fd:00 4816                           /lib64/libresolv-2.12.so
33a0816000-33a0817000 r--p 00016000 fd:00 4816                           /lib64/libresolv-2.12.so
33a0817000-33a0818000 rw-p 00017000 fd:00 4816                           /lib64/libresolv-2.12.so
33a0818000-33a081a000 rw-p 00000000 00:00 0
33a0e00000-33a0e16000 r-xp 00000000 fd:00 20680                          /lib64/libgcc_s-4.4.7-20120601.so.1
33a0e16000-33a1015000 ---p 00016000 fd:00 20680                          /lib64/libgcc_s-4.4.7-20120601.so.1
33a1015000-33a1016000 rw-p 00015000 fd:00 20680                          /lib64/libgcc_s-4.4.7-20120601.so.1
33a1e00000-33a1ee8000 r-xp 00000000 fd:00 21090                          /usr/lib64/libstdc++.so.6.0.13
33a1ee8000-33a20e8000 ---p 000e8000 fd:00 21090                          /usr/lib64/libstdc++.so.6.0.13
33a20e8000-33a20ef000 r--p 000e8000 fd:00 21090                          /usr/lib64/libstdc++.so.6.0.13
33a20ef000-33a20f1000 rw-p 000ef000 fd:00 21090                          /usr/lib64/libstdc++.so.6.0.13
33a20f1000-33a2106000 rw-p 00000000 00:00 0
33a2a00000-33a2a16000 r-xp 00000000 fd:00 30720                          /lib64/libnsl-2.12.so
33a2a16000-33a2c15000 ---p 00016000 fd:00 30720                          /lib64/libnsl-2.12.so
33a2c15000-33a2c16000 r--p 00015000 fd:00 30720                          /lib64/libnsl-2.12.so
33a2c16000-33a2c17000 rw-p 00016000 fd:00 30720                          /lib64/libnsl-2.12.so
33a2c17000-33a2c19000 rw-p 00000000 00:00 0
33a6200000-33a6204000 r-xp 00000000 fd:00 20177                          /lib64/libuuid.so.1.3.0
33a6204000-33a6403000 ---p 00004000 fd:00 20177                          /lib64/libuuid.so.1.3.0
33a6403000-33a6404000 rw-p 00003000 fd:00 20177                          /lib64/libuuid.so.1.3.0
3b9dc00000-3b9dc1b000 r-xp 00000000 fd:00 48539                          /usr/lib64/libgearman.so.6.0.0
3b9dc1b000-3b9de1b000 ---p 0001b000 fd:00 48539                          /usr/lib64/libgearman.so.6.0.0
3b9de1b000-3b9de1c000 rw-p 0001b000 fd:00 48539                          /usr/lib64/libgearman.so.6.0.0
7f4f24000000-7f4f24021000 rw-p 00000000 00:00 0
7f4f24021000-7f4f28000000 ---p 00000000 00:00 0
7f4f2c000000-7f4f2c025000 rw-p 00000000 00:00 0
7f4f2c025000-7f4f30000000 ---p 00000000 00:00 0
7f4f33608000-7f4f33609000 ---p 00000000 00:00 0
7f4f33609000-7f4f3408a000 rw-p 00000000 00:00 0
7f4f3408a000-7f4f3408f000 r-xp 00000000 fd:00 4501                       /lib64/libnss_dns-2.12.so
7f4f3408f000-7f4f3428e000 ---p 00005000 fd:00 4501                       /lib64/libnss_dns-2.12.so
7f4f3428e000-7f4f3428f000 r--p 00004000 fd:00 4501                       /lib64/libnss_dns-2.12.so
7f4f3428f000-7f4f34290000 rw-p 00005000 fd:00 4501                       /lib64/libnss_dns-2.12.soAborted

Any Ideas?

Re: NagiosXI 5.2.9 Issue with Monitoring Engine Startup

Posted: Fri Sep 30, 2016 10:20 am
by tmcdonald
That's a bug in mod_gearman - what version are you using?