Nagios Support Forum

Posted: **Fri Feb 16, 2018 12:20 pm**

Hi expert

I'm using nagios 4.3.4 with
gearmand 0.33
mod_gearman_worker: version 3.0.2

Do you know the right syntax to use in the nagios.cfg file to load broker module ?

I inserted:
broker_module=/usr/lib64/mod_gearman/mod_gearman_naemon.o config=/etc/mod_gearman/module.conf
but in the log I got
[1518800977] Error: Could not load module '/usr/lib64/mod_gearman/mod_gearman_naemon.o' -> /usr/lib64/mod_gearman/mod_gearman_naemon.o: undefined symbol: nm_log
[1518800977] Error: Failed to load module '/usr/lib64/mod_gearman/mod_gearman_naemon.o'.
[1518800977] Error: Module loading failed. Aborting.

broker_module=/usr/lib64/mod_gearman/mod_gearman_nagios4.o config=/etc/mod_gearman/module.conf
In the log I got a good info
[1518801037] mod_gearman: initialized version 3.0.2 (libgearman 0.33)
[1518801037] Event broker module '/usr/lib64/mod_gearman/mod_gearman_nagios4.o' initialized successfully.
[1518801037] Successfully launched command file worker with pid 42687

but I got
service nagios status
nagios is not running

and nagios doesn't work

Someone could help me ?
Regards and Thanks
Emilio

Posted: **Fri Feb 16, 2018 5:12 pm**

I'm currently using:

broker_module=/usr/lib64/mod_gearman2/mod_gearman2.o config=/etc/mod_gearman2/module.conf eventhandler=no

Does /etc/mod_gearman/module.conf exist? What are the permissions? Have you checked it for any typos ?

Posted: **Mon Feb 19, 2018 4:05 am**

Code: Select all

[root@sgsvrasnagc01lx:/usr/lib64/mod_gearman]# ll
total 3152
drwxr-xr-x.  2 root root    4096 Feb 16 11:38 ./
dr-xr-xr-x. 61 root root   40960 Feb 16 11:38 ../
-rw-r--r--   1 root root 1104607 May  6  2017 mod_gearman_naemon.o
-rw-r--r--   1 root root 1049852 May  6  2017 mod_gearman_nagios3.o
-rw-r--r--   1 root root 1019780 May  6  2017 mod_gearman_nagios4.o

I have not mod_gearman_nagios2.o but only 3 and 4

Code: Select all

-rw-r--r--    1 root root  6272 Feb 16 17:24 module.conf has right permission (is readable form every one)

When I restart nagios , I got in the log files

Code: Select all

[1519031041] Nagios 4.3.4 starting... (PID=102653)
[1519031041] Local time is Mon Feb 19 10:04:01 CET 2018
[1519031041] LOG VERSION: 2.0
[1519031041] qh: Socket '/var/spool/nagios/cmd/nagios.qh' successfully initialized
[1519031041] qh: core query handler registered
[1519031041] nerd: Channel hostchecks registered successfully
[1519031041] nerd: Channel servicechecks registered successfully
[1519031041] nerd: Channel opathchecks registered successfully
[1519031041] nerd: Fully initialized and ready to rock!
[1519031041] wproc: Successfully registered manager as @wproc with query handler
[1519031041] wproc: Registry request: name=Core Worker 102655;pid=102655
[1519031041] wproc: Registry request: name=Core Worker 102656;pid=102656
[1519031041] wproc: Registry request: name=Core Worker 102657;pid=102657
[1519031041] wproc: Registry request: name=Core Worker 102658;pid=102658
[1519031041] wproc: Registry request: name=Core Worker 102660;pid=102660
[1519031041] wproc: Registry request: name=Core Worker 102663;pid=102663
[1519031041] wproc: Registry request: name=Core Worker 102659;pid=102659
[1519031041] wproc: Registry request: name=Core Worker 102664;pid=102664
[1519031041] wproc: Registry request: name=Core Worker 102665;pid=102665
[1519031041] wproc: Registry request: name=Core Worker 102666;pid=102666
[1519031041] wproc: Registry request: name=Core Worker 102662;pid=102662
[1519031041] wproc: Registry request: name=Core Worker 102661;pid=102661
[1519031041] livestatus: Livestatus 1.2.6p16 by Mathias Kettner. Socket: '/var/spool/nagios/live'
[1519031041] livestatus: Please visit us at http://mathias-kettner.de/
[1519031041] livestatus: Hint: please try out OMD - the Open Monitoring Distribution
[1519031041] livestatus: Please visit OMD at http://omdistro.org
[1519031041] livestatus: Removed old left over socket file /var/spool/nagios/live
[1519031041] livestatus: Warning: environment_macros are enabled. This might decrease the overall nagios performance
[1519031041] livestatus: Finished initialization. Further log messages go to /var/log/nagios/livestatus.log
[1519031041] Event broker module '/usr/lib64/check_mk/livestatus.o' initialized successfully.
[1519031041] mod_gearman: initialized version 3.0.2 (libgearman 0.33)
[1519031041] Event broker module '/usr/lib64/mod_gearman/mod_gearman_nagios4.o' initialized successfully.
[1519031041] Successfully launched command file worker with pid 102667
[1519031041] TIMEPERIOD TRANSITION: 24X7;-1;1
[1519031041] TIMEPERIOD TRANSITION: 24x5;-1;1
[1519031041] TIMEPERIOD TRANSITION: 24x7;-1;1
[1519031041] TIMEPERIOD TRANSITION: 24x7_sans_holidays;-1;1
[1519031041] TIMEPERIOD TRANSITION: 4x7A_0330_2000;-1;0
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0030_2000;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0100_2000;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0330_2000;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0515_1915;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0630_2000;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0635_0600;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0645_0600;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0700_1900;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0700_2100;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0700_2200;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0700_2300;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0715_2200;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0730_1930;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0730_2100;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0730_2200;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0730_2215;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0730_2300;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0730_2330;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0745_1855;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0745_2015;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0745_2030;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0745_2200;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0745_2230;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0745_2330;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0750_1900;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0755_2230;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0800_1730;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0800_1745;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0800_1800;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0800_1830;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0800_1855;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0800_2030;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0800_2200;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0800_2300;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0805_0810;-1;0
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0810_1950;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0815_1945;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0815_2030;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0815_2115;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0825_0830;-1;0
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0830_2000;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0900_1730;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0900_2000;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0900_2030;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_0945_1700;-1;1
[1519031041] TIMEPERIOD TRANSITION: 5x7A_1800_2030;-1;0
[1519031041] TIMEPERIOD TRANSITION: 5x7A_2300_2330;-1;0
[1519031041] TIMEPERIOD TRANSITION: 5x7A_2330_2359;-1;0
[1519031041] TIMEPERIOD TRANSITION: 6x7A_0000_2400_NO_SA;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_0100_0400;-1;0
[1519031041] TIMEPERIOD TRANSITION: 6x7A_0510_2345;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_0600_1900;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_0600_2030;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_0600_2030_S0700;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_0600_2100;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_0600_2130;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_0630_0530;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_0700_2000;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_0700_2100;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_2145_2000;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_2200_2000;-1;1
[1519031041] TIMEPERIOD TRANSITION: 6x7A_2200_2030;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0000_1900;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0000_2230;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0130_2230;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0300_2330;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0400_0600;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0540_2115;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0545_0455;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0700_0600;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0700_0705;-1;0
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0700_2200;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0700_2230;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0730_2330;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0800_1900;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0800_2200;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0830_2200;-1;1
[1519031041] TIMEPERIOD TRANSITION: 7x7A_0900_2200;-1;1
[1519031041] TIMEPERIOD TRANSITION: BancaTelefonica;-1;1
[1519031041] TIMEPERIOD TRANSITION: none;-1;0
[1519031041] TIMEPERIOD TRANSITION: nonworkhours;-1;0
[1519031041] TIMEPERIOD TRANSITION: us-holidays;-1;0
[1519031041] TIMEPERIOD TRANSITION: workhours;-1;1
[1519031043] Caught SIGSEGV, shutting down...

Do you have any suggestion ?

thanks
Emilio

Posted: **Mon Feb 19, 2018 4:09 am**

for your info I follow these start step

1) I run gearmad daemo
/etc/init.d/gearmand start

2) I run mod_gearman_worker
/etc/init.d/mod_gearman_worker start

3)I run nagios
service nagios start

Posted: **Tue Feb 20, 2018 5:51 pm**

Please run the following and post the last 50 or so lines of output:

strace -s 256 -f <path/to/nagios> </path/to/nagios.cfg>

Make sure of course to replace the <path> entries with the correct locations on your system.

You may need to do a yum install strace or apt install strace first depending on your OS.

Posted: **Tue Feb 20, 2018 5:57 pm**

In addition to what @tmcdonald asked, you can try this.

Comment out all of the brokers in the nagios.cfg file and see if Nagios starts.
It if does, enable the Gearman Broker and see if it starts.

If it fails, tale a look in the messages file for any errors.
Typically it is located at /var/log/messages

And also the Gearman Server log files which are typically in this folder/var/log/mod_gearman2, check them for any errors.

Posted: **Wed Feb 21, 2018 2:56 am**

I run gearmand and mod_gearman_worker

strace -s 256 -f /usr/sbin/nagios /etc/nagios/nagios.cfg

here the results

Code: Select all

[pid 51983] recvfrom(28, "\0RES\0\0\0\10\0\0\0\34H:sgsvrasnagc01lx.servizi:13", 8192, 0, NULL, NULL) = 40
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] epoll_wait(3, {}, 14, 0)    = 0
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] rt_sigaction(SIGPIPE, {SIG_IGN, [PIPE], SA_RESTORER|SA_RESTART, 0x7f576ea6a510}, {SIG_IGN, [PIPE], SA_RESTORER|SA_RESTART, 0x7f576ea6a510}, 8) = 0
[pid 51983] sendto(28, "\0REQ\0\0\0\"\0\0\1\245service\0SGSVRDBRACT02AX-UX_Check_CPU\0AH9qkiUjW6QPgTQL3Zl7e7srGlAI/oq66u6PrVqz71oZQ5oe6zl4SpoHm5OLu8pyeC9Fw6uIoSfn+wnuNovUALAj44Tt4QW2hZylKfSILnvRJCKks0aJie+Lt5tUsQbMGrYz5Q+tUJ6EVklme6869wHbzE61FAx0Pvplc1pSh9Ab/oB1fNJ0hiJH5MEyhO1RPGbLkvIYQisXrt4"..., 433, MSG_DONTWAIT|MSG_NOSIGNAL, NULL, 0) = 433
[pid 51983] poll([{fd=28, events=POLLIN}], 1, -1) = 1 ([{fd=28, revents=POLLIN}])
[pid 51983] getsockopt(28, SOL_SOCKET, SO_ERROR, [0], [4]) = 0
[pid 51983] recvfrom(28, "\0RES\0\0\0\10\0\0\0\34H:sgsvrasnagc01lx.servizi:14", 8192, 0, NULL, NULL) = 40
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] epoll_wait(3, {}, 14, 0)    = 0
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] rt_sigaction(SIGPIPE, {SIG_IGN, [PIPE], SA_RESTORER|SA_RESTART, 0x7f576ea6a510}, {SIG_IGN, [PIPE], SA_RESTORER|SA_RESTART, 0x7f576ea6a510}, 8) = 0
[pid 51983] sendto(28, "\0REQ\0\0\0\"\0\0\1\246service\0SISVRWSIIS002W8-WIN_Check_CPU\0AH9qkiUjW6QPgTQL3Zl7e7srGlAI/oq66u6PrVqz71oZQ5oe6zl4SpoHm5OLu8py0OpFfrm8CoYufbLZmzrGuuiojWMBTubDsOO0LXL0NwQiY/ghb60VCpZGSz9Dpxu17tih3gluXcrPWZOXlVXiP1tQiMavTGzmbjO1VRT/2qtEY4gqk75on/xNs+fZ6kdLnskZoJl8vo69BC"..., 434, MSG_DONTWAIT|MSG_NOSIGNAL, NULL, 0) = 434
[pid 51983] poll([{fd=28, events=POLLIN}], 1, -1) = 1 ([{fd=28, revents=POLLIN}])
[pid 51983] getsockopt(28, SOL_SOCKET, SO_ERROR, [0], [4]) = 0
[pid 51983] recvfrom(28, "\0RES\0\0\0\10\0\0\0\34H:sgsvrasnagc01lx.servizi:15", 8192, 0, NULL, NULL) = 40
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] epoll_wait(3, {}, 14, 7)    = 0
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2666, ...}) = 0
[pid 51983] --- SIGSEGV {si_signo=SIGSEGV, si_code=SEGV_MAPERR, si_addr=0x284} ---
[pid 52005] +++ killed by SIGSEGV +++
[pid 52001] +++ killed by SIGSEGV +++
[pid 52008] +++ killed by SIGSEGV +++
[pid 52003] +++ killed by SIGSEGV +++
[pid 51999] +++ killed by SIGSEGV +++
[pid 51997] +++ killed by SIGSEGV +++
[pid 52000] +++ killed by SIGSEGV +++
[pid 51998] +++ killed by SIGSEGV +++
[pid 52002] +++ killed by SIGSEGV +++
[pid 52004] +++ killed by SIGSEGV +++
[pid 52006] +++ killed by SIGSEGV +++
[pid 52007] +++ killed by SIGSEGV +++
[pid 51983] +++ killed by SIGSEGV +++
[pid 51996] <... poll resumed> )        = 0 (Timeout)
[pid 51996] kill(51983, SIG_0)          = -1 ESRCH (No such process)
[pid 51996] exit_group(0)               = ?
[pid 51985] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51987] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51988] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51986] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51984] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51996] +++ exited with 0 +++
[pid 51995] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51994] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51993] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51992] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51991] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51990] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51989] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid 51988] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51987] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51986] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51985] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51984] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51995] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51994] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51993] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51992] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51991] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51990] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51989] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid 51988] <... mmap resumed> )        = 0x7f315070e000
[pid 51987] <... mmap resumed> )        = 0x7f5ecd715000
[pid 51986] <... mmap resumed> )        = 0x7f65b926c000
[pid 51985] <... mmap resumed> )        = 0x7f4c6139c000
[pid 51995] <... mmap resumed> )        = 0x7f24ee051000
[pid 51994] <... mmap resumed> )        = 0x7f557c66b000
[pid 51993] <... mmap resumed> )        = 0x7f0535e5d000
[pid 51992] <... mmap resumed> )        = 0x7f107cb23000
[pid 51991] <... mmap resumed> )        = 0x7f0aaeee5000
[pid 51990] <... mmap resumed> )        = 0x7f1f623ab000
[pid 51989] <... mmap resumed> )        = 0x7fde7ec43000
[pid 51988] read(3,  <unfinished ...>
[pid 51987] read(3,  <unfinished ...>
[pid 51986] read(3,  <unfinished ...>
[pid 51985] read(3,  <unfinished ...>
[pid 51984] <... mmap resumed> )        = 0x7fe9efc91000
[pid 51995] read(3,  <unfinished ...>
[pid 51994] read(3,  <unfinished ...>
[pid 51993] read(3,  <unfinished ...>
[pid 51992] read(3,  <unfinished ...>
[pid 51991] read(3,  <unfinished ...>
[pid 51990] read(3,  <unfinished ...>
[pid 51989] read(3,  <unfinished ...>
[pid 51988] <... read resumed> "", 524288) = 0
[pid 51987] <... read resumed> "", 524288) = 0
[pid 51986] <... read resumed> "", 524288) = 0
[pid 51985] <... read resumed> "", 524288) = 0
[pid 51984] read(3,  <unfinished ...>
[pid 51995] <... read resumed> "", 524288) = 0
[pid 51994] <... read resumed> "", 524288) = 0
[pid 51993] <... read resumed> "", 524288) = 0
[pid 51992] <... read resumed> "", 524288) = 0
[pid 51991] <... read resumed> "", 524288) = 0
[pid 51990] <... read resumed> "", 524288) = 0
[pid 51989] <... read resumed> "", 524288) = 0
[pid 51988] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51987] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51986] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51984] <... read resumed> "", 524288) = 0
[pid 51995] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51994] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51993] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51992] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51991] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51990] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51989] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51988] <... epoll_ctl resumed> )   = 0
[pid 51987] <... epoll_ctl resumed> )   = 0
[pid 51986] <... epoll_ctl resumed> )   = 0
[pid 51985] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51984] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid 51995] <... epoll_ctl resumed> )   = 0
[pid 51994] <... epoll_ctl resumed> )   = 0
[pid 51993] <... epoll_ctl resumed> )   = 0
[pid 51992] <... epoll_ctl resumed> )   = 0
[pid 51991] <... epoll_ctl resumed> )   = 0
[pid 51990] <... epoll_ctl resumed> )   = 0
[pid 51989] <... epoll_ctl resumed> )   = 0
[pid 51988] close(3 <unfinished ...>
[pid 51987] close(3 <unfinished ...>
[pid 51985] <... epoll_ctl resumed> )   = 0
[pid 51984] <... epoll_ctl resumed> )   = 0
[pid 51995] close(3 <unfinished ...>
[pid 51994] close(3 <unfinished ...>
[pid 51993] close(3 <unfinished ...>
[pid 51992] close(3 <unfinished ...>
[pid 51991] close(3 <unfinished ...>
[pid 51990] close(3 <unfinished ...>
[pid 51989] close(3 <unfinished ...>
[pid 51988] <... close resumed> )       = 0
[pid 51987] <... close resumed> )       = 0
[pid 51986] close(3 <unfinished ...>
[pid 51985] close(3 <unfinished ...>
[pid 51984] close(3 <unfinished ...>
[pid 51995] <... close resumed> )       = 0
[pid 51994] <... close resumed> )       = 0
[pid 51993] <... close resumed> )       = 0
[pid 51992] <... close resumed> )       = 0
[pid 51991] <... close resumed> )       = 0
[pid 51990] <... close resumed> )       = 0
[pid 51989] <... close resumed> )       = 0
[pid 51988] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7f314fd98510},  <unfinished ...>
[pid 51987] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7f5eccd9f510},  <unfinished ...>
[pid 51986] <... close resumed> )       = 0
[pid 51985] <... close resumed> )       = 0
[pid 51984] <... close resumed> )       = 0
[pid 51995] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7f24ed6db510},  <unfinished ...>
[pid 51994] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7f557bcf5510},  <unfinished ...>
[pid 51993] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7f05354e7510},  <unfinished ...>
[pid 51992] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7f107c1ad510},  <unfinished ...>
[pid 51991] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7f0aae56f510},  <unfinished ...>
[pid 51990] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7f1f61a35510},  <unfinished ...>
[pid 51989] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7fde7e2cd510},  <unfinished ...>
[pid 51988] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51987] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51986] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7f65b88f6510},  <unfinished ...>
[pid 51985] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7f4c60a26510},  <unfinished ...>
[pid 51984] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x7fe9ef31b510},  <unfinished ...>
[pid 51995] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51994] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51993] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51992] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51991] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51990] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51989] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51988] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7f314fd98510},  <unfinished ...>
[pid 51987] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7f5eccd9f510},  <unfinished ...>
[pid 51986] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51985] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51984] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51995] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7f24ed6db510},  <unfinished ...>
[pid 51994] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7f557bcf5510},  <unfinished ...>
[pid 51993] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7f05354e7510},  <unfinished ...>
[pid 51992] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7f107c1ad510},  <unfinished ...>
[pid 51991] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7f0aae56f510},  <unfinished ...>
[pid 51990] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7f1f61a35510},  <unfinished ...>
[pid 51989] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7fde7e2cd510},  <unfinished ...>
[pid 51988] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51987] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51986] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7f65b88f6510},  <unfinished ...>
[pid 51985] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7f4c60a26510},  <unfinished ...>
[pid 51984] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x7fe9ef31b510},  <unfinished ...>
[pid 51995] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51994] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51993] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51992] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51991] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51990] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51989] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51988] kill(0, SIGTERM <unfinished ...>
[pid 51987] kill(0, SIGTERM <unfinished ...>
[pid 51986] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51985] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51984] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid 51995] kill(0, SIGTERM <unfinished ...>
[pid 51994] kill(0, SIGTERM <unfinished ...>
[pid 51993] kill(0, SIGTERM <unfinished ...>
[pid 51992] kill(0, SIGTERM <unfinished ...>
[pid 51991] kill(0, SIGTERM <unfinished ...>
[pid 51990] kill(0, SIGTERM <unfinished ...>
[pid 51989] kill(0, SIGTERM <unfinished ...>
[pid 51988] <... kill resumed> )        = 0
[pid 51987] <... kill resumed> )        = 0
[pid 51986] kill(0, SIGTERM <unfinished ...>
[pid 51985] kill(0, SIGTERM <unfinished ...>
[pid 51984] kill(0, SIGTERM <unfinished ...>
[pid 51995] <... kill resumed> )        = 0
[pid 51994] <... kill resumed> )        = 0
[pid 51993] <... kill resumed> )        = 0
[pid 51992] <... kill resumed> )        = 0
[pid 51991] <... kill resumed> )        = 0
[pid 51990] <... kill resumed> )        = 0
[pid 51989] <... kill resumed> )        = 0
[pid 51988] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51988, si_uid=1002} ---
[pid 51987] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51987, si_uid=1002} ---
[pid 51986] <... kill resumed> )        = 0
[pid 51985] <... kill resumed> )        = 0
[pid 51984] <... kill resumed> )        = 0
[pid 51995] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51995, si_uid=1002} ---
[pid 51994] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51994, si_uid=1002} ---
[pid 51993] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51993, si_uid=1002} ---
[pid 51992] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51992, si_uid=1002} ---
[pid 51991] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51991, si_uid=1002} ---
[pid 51990] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51990, si_uid=1002} ---
[pid 51989] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51989, si_uid=1002} ---
[pid 51988] wait4(-1,  <unfinished ...>
[pid 51987] wait4(-1,  <unfinished ...>
[pid 51986] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51986, si_uid=1002} ---
[pid 51985] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51985, si_uid=1002} ---
[pid 51984] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=51984, si_uid=1002} ---
[pid 51995] wait4(-1,  <unfinished ...>
[pid 51994] wait4(-1,  <unfinished ...>
[pid 51993] wait4(-1,  <unfinished ...>
[pid 51992] wait4(-1,  <unfinished ...>
[pid 51991] wait4(-1,  <unfinished ...>
[pid 51990] wait4(-1,  <unfinished ...>
[pid 51989] wait4(-1,  <unfinished ...>
[pid 51988] <... wait4 resumed> 0x7fff25b5d56c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51987] <... wait4 resumed> 0x7fff05b94cec, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51986] wait4(-1,  <unfinished ...>
[pid 51985] wait4(-1,  <unfinished ...>
[pid 51984] wait4(-1,  <unfinished ...>
[pid 51995] <... wait4 resumed> 0x7fff6fc4f24c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51994] <... wait4 resumed> 0x7ffdbf34e67c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51993] <... wait4 resumed> 0x7ffd312c3d6c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51992] <... wait4 resumed> 0x7ffd8cf4053c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51991] <... wait4 resumed> 0x7ffe1635cbac, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51990] <... wait4 resumed> 0x7fff8ac529ac, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51989] <... wait4 resumed> 0x7ffdad694a9c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51988] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51987] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51986] <... wait4 resumed> 0x7ffec49d887c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51985] <... wait4 resumed> 0x7ffd518fcffc, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51984] <... wait4 resumed> 0x7ffc3413fb7c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51995] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51994] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51993] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51992] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51991] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51990] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51989] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51988] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51987] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51986] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51985] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51984] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51995] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51994] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51993] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51992] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51991] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51990] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51989] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51988] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51987] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51986] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51985] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51984] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51995] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51994] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51993] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51992] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51991] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51990] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51989] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51988] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f314fd98510}, 8) = 0
[pid 51987] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f5eccd9f510}, 8) = 0
[pid 51986] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51985] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51984] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51995] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f24ed6db510}, 8) = 0
[pid 51994] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f557bcf5510}, 8) = 0
[pid 51993] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f05354e7510}, 8) = 0
[pid 51992] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f107c1ad510}, 8) = 0
[pid 51991] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f0aae56f510}, 8) = 0
[pid 51990] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f1f61a35510}, 8) = 0
[pid 51989] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7fde7e2cd510}, 8) = 0
[pid 51988] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51987] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51986] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f65b88f6510}, 8) = 0
[pid 51985] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f4c60a26510}, 8) = 0
[pid 51984] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7fe9ef31b510}, 8) = 0
[pid 51995] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51994] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51993] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51992] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51991] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51990] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51989] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51988] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51987] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51986] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51985] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51984] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51995] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51994] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51993] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51992] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51991] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51990] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51989] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51988] nanosleep({1, 0},  <unfinished ...>
[pid 51987] nanosleep({1, 0},  <unfinished ...>
[pid 51986] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51985] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51984] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51995] nanosleep({1, 0},  <unfinished ...>
[pid 51994] nanosleep({1, 0},  <unfinished ...>
[pid 51993] nanosleep({1, 0},  <unfinished ...>
[pid 51992] nanosleep({1, 0},  <unfinished ...>
[pid 51991] nanosleep({1, 0},  <unfinished ...>
[pid 51990] nanosleep({1, 0},  <unfinished ...>
[pid 51989] nanosleep({1, 0},  <unfinished ...>
[pid 51986] nanosleep({1, 0},  <unfinished ...>
[pid 51985] nanosleep({1, 0},  <unfinished ...>
[pid 51984] nanosleep({1, 0},  <unfinished ...>
[pid 51995] <... nanosleep resumed> 0x7fff6fc4f200) = 0
[pid 51994] <... nanosleep resumed> 0x7ffdbf34e630) = 0
[pid 51993] <... nanosleep resumed> 0x7ffd312c3d20) = 0
[pid 51992] <... nanosleep resumed> 0x7ffd8cf404f0) = 0
[pid 51989] <... nanosleep resumed> 0x7ffdad694a50) = 0
[pid 51988] <... nanosleep resumed> 0x7fff25b5d520) = 0
[pid 51985] <... nanosleep resumed> 0x7ffd518fcfb0) = 0
[pid 51995] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51994] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51993] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51992] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51991] <... nanosleep resumed> 0x7ffe1635cb60) = 0
[pid 51987] <... nanosleep resumed> 0x7fff05b94ca0) = 0
[pid 51990] <... nanosleep resumed> 0x7fff8ac52960) = 0
[pid 51986] <... nanosleep resumed> 0x7ffec49d8830) = 0
[pid 51989] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51988] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51985] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51984] <... nanosleep resumed> 0x7ffc3413fb30) = 0
[pid 51995] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51994] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51993] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51992] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51991] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51990] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51989] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51988] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51987] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51986] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51985] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51984] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid 51995] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51994] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51993] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51992] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51991] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51990] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51989] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51988] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51987] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51986] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51985] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51984] <... rt_sigprocmask resumed> [], 8) = 0
[pid 51995] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f24ed6db510}, 8) = 0
[pid 51994] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f557bcf5510}, 8) = 0
[pid 51993] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f05354e7510}, 8) = 0
[pid 51992] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f107c1ad510}, 8) = 0
[pid 51991] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51990] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51989] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7fde7e2cd510}, 8) = 0
[pid 51988] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f314fd98510}, 8) = 0
[pid 51987] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51986] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51985] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f4c60a26510}, 8) = 0
[pid 51984] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid 51995] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51994] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51993] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51992] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51991] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f0aae56f510}, 8) = 0
[pid 51990] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f1f61a35510}, 8) = 0
[pid 51989] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51988] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51987] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f5eccd9f510}, 8) = 0
[pid 51986] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7f65b88f6510}, 8) = 0
[pid 51985] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51984] <... rt_sigaction resumed> {0x475610, [CHLD], SA_RESTORER|SA_RESTART, 0x7fe9ef31b510}, 8) = 0
[pid 51995] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51994] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51993] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51992] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51991] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51990] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51989] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51988] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51987] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51986] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51985] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51984] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid 51995] nanosleep({1, 0},  <unfinished ...>
[pid 51994] nanosleep({1, 0},  <unfinished ...>
[pid 51993] nanosleep({1, 0},  <unfinished ...>
[pid 51992] nanosleep({1, 0},  <unfinished ...>
[pid 51991] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51990] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51989] nanosleep({1, 0},  <unfinished ...>
[pid 51988] nanosleep({1, 0},  <unfinished ...>
[pid 51987] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51986] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51985] nanosleep({1, 0},  <unfinished ...>
[pid 51984] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid 51991] nanosleep({1, 0},  <unfinished ...>
[pid 51990] nanosleep({1, 0},  <unfinished ...>
[pid 51987] nanosleep({1, 0},  <unfinished ...>
[pid 51986] nanosleep({1, 0},  <unfinished ...>
[pid 51984] nanosleep({1, 0},  <unfinished ...>
[pid 51995] <... nanosleep resumed> 0x7fff6fc4f200) = 0
[pid 51994] <... nanosleep resumed> 0x7ffdbf34e630) = 0
[pid 51993] <... nanosleep resumed> 0x7ffd312c3d20) = 0
[pid 51992] <... nanosleep resumed> 0x7ffd8cf404f0) = 0
[pid 51989] <... nanosleep resumed> 0x7ffdad694a50) = 0
[pid 51988] <... nanosleep resumed> 0x7fff25b5d520) = 0
[pid 51985] <... nanosleep resumed> 0x7ffd518fcfb0) = 0
[pid 51995] wait4(-1,  <unfinished ...>
[pid 51994] wait4(-1,  <unfinished ...>
[pid 51993] wait4(-1,  <unfinished ...>
[pid 51991] <... nanosleep resumed> 0x7ffe1635cb60) = 0
[pid 51992] wait4(-1,  <unfinished ...>
[pid 51990] <... nanosleep resumed> 0x7fff8ac52960) = 0
[pid 51989] wait4(-1,  <unfinished ...>
[pid 51988] wait4(-1,  <unfinished ...>
[pid 51987] <... nanosleep resumed> 0x7fff05b94ca0) = 0
[pid 51986] <... nanosleep resumed> 0x7ffec49d8830) = 0
[pid 51985] wait4(-1,  <unfinished ...>
[pid 51984] <... nanosleep resumed> 0x7ffc3413fb30) = 0
[pid 51995] <... wait4 resumed> 0x7fff6fc4f24c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51994] <... wait4 resumed> 0x7ffdbf34e67c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51993] <... wait4 resumed> 0x7ffd312c3d6c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51992] <... wait4 resumed> 0x7ffd8cf4053c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51991] wait4(-1,  <unfinished ...>
[pid 51990] wait4(-1,  <unfinished ...>
[pid 51989] <... wait4 resumed> 0x7ffdad694a9c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51988] <... wait4 resumed> 0x7fff25b5d56c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51987] wait4(-1,  <unfinished ...>
[pid 51986] wait4(-1,  <unfinished ...>
[pid 51985] <... wait4 resumed> 0x7ffd518fcffc, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51984] wait4(-1,  <unfinished ...>
[pid 51995] exit_group(0)               = ?
[pid 51994] exit_group(0)               = ?
[pid 51993] exit_group(0)               = ?
[pid 51992] exit_group(0)               = ?
[pid 51991] <... wait4 resumed> 0x7ffe1635cbac, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51990] <... wait4 resumed> 0x7fff8ac529ac, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51989] exit_group(0)               = ?
[pid 51988] exit_group(0)               = ?
[pid 51987] <... wait4 resumed> 0x7fff05b94cec, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51986] <... wait4 resumed> 0x7ffec49d887c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51985] exit_group(0)               = ?
[pid 51984] <... wait4 resumed> 0x7ffc3413fb7c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid 51990] exit_group(0)               = ?
[pid 51987] exit_group(0)               = ?
[pid 51986] exit_group(0)               = ?
[pid 51995] +++ exited with 0 +++
[pid 51994] +++ exited with 0 +++
[pid 51993] +++ exited with 0 +++
[pid 51992] +++ exited with 0 +++
[pid 51991] exit_group(0)               = ?
[pid 51990] +++ exited with 0 +++
[pid 51989] +++ exited with 0 +++
[pid 51988] +++ exited with 0 +++
[pid 51987] +++ exited with 0 +++
[pid 51986] +++ exited with 0 +++
[pid 51985] +++ exited with 0 +++
[pid 51984] exit_group(0)               = ?
[pid 51984] +++ exited with 0 +++
+++ exited with 0 +++
Segmentation fault
[root@sgsvrasnagc01lx:~]#

Posted: **Thu Feb 22, 2018 11:51 am**

Thanks for the strace output. It didn't have any definitive clues on why Nagios generated a Segmentation fault and crashed.

Can you comment out all of the brokers in the nagios.cfg file to see if it will start up?
It if does, re-enable the Gearman Broker using the following example and see if it starts.

Code: Select all

broker_module=/usr/lib64/mod_gearman/mod_gearman_nagios4.o config=/etc/mod_gearman/module.conf eventhandler=no

If it fails, can you post the last 50 lines of the nagios.log file as well as the last 50 lines of the Gearman server log file?
The typical location for that file is in this folder /var/log/mod_gearman2
Also, a copy of the nagios.cfg file would be helpful.

Thanks

Posted: **Fri Feb 23, 2018 7:05 am**

If I remove all broker module from nagios.cfg , nagios starts well

If I put you broker suggested line
broker_module=/usr/lib64/mod_gearman/mod_gearman_nagios4.o config=/etc/mod_gearman/module.conf eventhandler=no

Nagios doesn't start

in the nagios log I found

[1519387208] Nagios 4.3.4 starting... (PID=20638)
[1519387208] Local time is Fri Feb 23 13:00:08 CET 2018
[1519387208] LOG VERSION: 2.0
[1519387208] qh: Socket '/var/spool/nagios/cmd/nagios.qh' successfully initialized
[1519387208] qh: core query handler registered
[1519387208] nerd: Channel hostchecks registered successfully
[1519387208] nerd: Channel servicechecks registered successfully
[1519387208] nerd: Channel opathchecks registered successfully
[1519387208] nerd: Fully initialized and ready to rock!
[1519387208] wproc: Successfully registered manager as @wproc with query handler
[1519387208] wproc: Registry request: name=Core Worker 20641;pid=20641
[1519387208] wproc: Registry request: name=Core Worker 20640;pid=20640
[1519387208] wproc: Registry request: name=Core Worker 20643;pid=20643
[1519387208] wproc: Registry request: name=Core Worker 20642;pid=20642
[1519387208] wproc: Registry request: name=Core Worker 20644;pid=20644
[1519387208] wproc: Registry request: name=Core Worker 20648;pid=20648
[1519387208] wproc: Registry request: name=Core Worker 20649;pid=20649
[1519387208] wproc: Registry request: name=Core Worker 20646;pid=20646
[1519387208] wproc: Registry request: name=Core Worker 20651;pid=20651
[1519387208] wproc: Registry request: name=Core Worker 20647;pid=20647
[1519387208] wproc: Registry request: name=Core Worker 20645;pid=20645
[1519387208] wproc: Registry request: name=Core Worker 20650;pid=20650
[1519387208] mod_gearman: initialized version 3.0.2 (libgearman 0.33)
[1519387208] Event broker module '/usr/lib64/mod_gearman/mod_gearman_nagios4.o' initialized successfully.
[1519387209] Successfully launched command file worker with pid 20652
[1519387209] Caught SIGSEGV, shutting down...

I attach nagios.cfg conf dile

Posted: **Fri Feb 23, 2018 8:53 am**

I have not information into
/var/log/mod_gearman/gearmand.log

(the file is empty)

Nagios Support Forum

Nagios core 4.3.4 and gearmand

Nagios core 4.3.4 and gearmand

Re: Nagios core 4.3.4 and gearmand

Re: Nagios core 4.3.4 and gearmand

Re: Nagios core 4.3.4 and gearmand

Re: Nagios core 4.3.4 and gearmand

Re: Nagios core 4.3.4 and gearmand

Re: Nagios core 4.3.4 and gearmand

Re: Nagios core 4.3.4 and gearmand

Re: Nagios core 4.3.4 and gearmand

Re: Nagios core 4.3.4 and gearmand