NagiosCore Segmentation Fault after adding host-checks

comsupport · Post by **comsupport** » Tue Jan 17, 2017 10:33 am

Hi there,

In NagiosXI i enabled some checks for a host and now the nagios process /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg stops working.
I checked the configuration with:

Code: Select all

[root@kdc004 etc]# /usr/local/nagios/bin/nagios -v /usr/local/nagios/etc/nagios.cfg

Nagios Core 4.2.4
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 12-07-2016
License: GPL

Website: https://www.nagios.org
Reading configuration data...
   Read main config file okay...
Warning: Duplicate definition found for service 'Cluster Eschen - Cluster CPU Usage' on host 'kdcesx010.kncorp.group.local' (config file '/usr/local/nagios/etc/services/kdcesx010.kncorp.group.local.cfg', starting on line 16)
Warning: Duplicate definition found for service 'Ping' on host 'rp2-egs.kncorp.group.local' (config file '/usr/local/nagios/etc/services/firewall-ping.cfg', starting on line 16)
Warning: Duplicate definition found for service 'Ping' on host 'ksc001.kncorp.group.local' (config file '/usr/local/nagios/etc/services/firewall-ping.cfg', starting on line 16)
Warning: Duplicate definition found for service 'Ping' on host 'rp2-eps.kncorp.group.local' (config file '/usr/local/nagios/etc/services/firewall-ping.cfg', starting on line 16)
   Read object config files okay...

Running pre-flight check on configuration data...

Checking objects...
        Checked 4121 services.
        Checked 450 hosts.
        Checked 20 host groups.
        Checked 15 service groups.
        Checked 23 contacts.
        Checked 35 contact groups.
        Checked 228 commands.
        Checked 34 time periods.
        Checked 0 host escalations.
        Checked 0 service escalations.
Checking for circular paths...
        Checked 450 hosts
        Checked 212 service dependencies
        Checked 0 host dependencies
        Checked 34 timeperiods
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...

Total Warnings: 0
Total Errors:   0

Things look okay - No serious problems were detected during the pre-flight check
[root@kdc004 etc]#

Starting nagios by hand with

Code: Select all

[root@kdc004 etc]# /usr/local/nagios/bin/nagios /usr/local/nagios/etc/nagios.cfg

Nagios Core 4.2.4
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 12-07-2016
License: GPL

Website: https://www.nagios.org
Nagios 4.2.4 starting... (PID=25179)
Local time is Tue Jan 17 16:20:00 CET 2017
nerd: Channel hostchecks registered successfully
nerd: Channel servicechecks registered successfully
nerd: Channel opathchecks registered successfully
nerd: Fully initialized and ready to rock!
wproc: Successfully registered manager as @wproc with query handler
wproc: Registry request: name=Core Worker 25180;pid=25180
wproc: Registry request: name=Core Worker 25181;pid=25181
wproc: Registry request: name=Core Worker 25182;pid=25182
wproc: Registry request: name=Core Worker 25185;pid=25185
wproc: Registry request: name=Core Worker 25184;pid=25184
wproc: Registry request: name=Core Worker 25183;pid=25183
Event broker module '/usr/local/nagios/bin/ndomod.o' initialized successfully.
Warning: Duplicate definition found for service 'Cluster Eschen - Cluster CPU Usage' on host 'kdcesx010.kncorp.group.local' (config file '/usr/local/nagios/etc/services/kdcesx010.kncorp.group.local.cfg', starting on line 16)
Warning: Duplicate definition found for service 'Ping' on host 'rp2-egs.kncorp.group.local' (config file '/usr/local/nagios/etc/services/firewall-ping.cfg', starting on line 16)
Warning: Duplicate definition found for service 'Ping' on host 'ksc001.kncorp.group.local' (config file '/usr/local/nagios/etc/services/firewall-ping.cfg', starting on line 16)
Warning: Duplicate definition found for service 'Ping' on host 'rp2-eps.kncorp.group.local' (config file '/usr/local/nagios/etc/services/firewall-ping.cfg', starting on line 16)
Segmentation fault
[root@kdc004 etc]#

dmesg gave following output

Code: Select all

dmesg
...
nagios[25179]: segfault at 197e000 ip 0000003fcca7f791 sp 00007ffefd0d0ba8 error 6 in libc-2.12.so[3fcca00000+18a000]
nagios[26741]: segfault at 2fb6000 ip 0000003fcca7f770 sp 00007ffc07b11f18 error 6 in libc-2.12.so[3fcca00000+18a000]

Any idea?

Best Regards
Zlatko

tmcdonald · Post by **tmcdonald** » Tue Jan 17, 2017 10:44 am

Please run the following and post the last 100 or so lines of output:

Code: Select all

cd /usr/local/nagios/bin/
strace -f -s 255 ./nagios ../etc/nagios.cfg

If you do not have strace, you can install it with yum install strace.

Also, what XI version are you on? Looks like 5.4.0 according to your Core version but I want to make sure.

comsupport · Post by **comsupport** » Wed Jan 18, 2017 8:02 am

Many Thanks,

We have Nagios XI 5.4.0.

Here the strace output:

Code: Select all

[pid  4736] write(13, "\n402:\n4=1484744447.843712\n174=ws3db.krausnaimer.com\n258=Users\n210=Users\n207=check_nrpe!xi_check_users!-a '-w 5 -c 10'\n211=\n224=xi_timeperiod_24x7\n209=xi_timeperiod_24x7\n214=\n208=5.00000\n226=1.00000\n185=5\n246=0.00000\n223=240.00000\n196=1\n197=1\n193=1\n195=1\n1"..., 492) = 492
[pid  4736] write(13, "\n402:\n4=1484744447.843712\n174=ws3db.krausnaimer.com\n258=Zypper Updates\n210=Zypper Updates\n207=check_nrpe!check_zypper!\n211=\n224=xi_timeperiod_24x7\n209=xi_timeperiod_24x7\n214=\n208=5.00000\n226=1.00000\n185=5\n246=0.00000\n223=240.00000\n196=1\n197=1\n193=1\n195=1\n"..., 493) = 493
[pid  4736] write(13, "\n402:\n4=1484744447.843712\n174=ws3db.krausnaimer.com\n258=network time protocol daemon\n210=network time protocol daemon\n207=check_nrpe!check_init_service!-a 'ntp'\n211=\n224=xi_timeperiod_24x7\n209=xi_timeperiod_24x7\n214=\n208=5.00000\n226=1.00000\n185=5\n246=0.00"..., 535) = 535
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=all_vmwareesxvsphere_services_cpu\n218=All VMware ESX or vSphere Services - CPU\n999\n\n", 114) = 114
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=all_vmwareesxvsphere_services_datastore\n218=All VMware ESX or vSphere Services - Datastore\n999\n\n", 126) = 126
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=all_vmwareesxvsphere_services_memory\n218=All VMware ESX or vSphere Services - Memory\n999\n\n", 120) = 120
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=all_vmwarevcenter_services_clusters\n218=All VMware vCenter Services - Clusters\n999\n\n", 114) = 114
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=all_vmwarevcenter_services_datacenters\n218=All VMware vCenter Services - Datacenters\n999\n\n", 120) = 120
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=all_vmwarevcenter_services_storage_arrays\n218=All VMware vCenter Services - storage_arrays\n999\n\n", 126) = 126
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=backup-checks\n218=Backup checks\n219=kdc062.kncorp.group.local;ORA database WEBREPV - backup\n219=kdc062.kncorp.group.local;ORA database RMANB - backup\n219=kdc062.kncorp.group.local;ORA database LOGAV - backup\n219=kdc062.kncorp"..., 1027) = 1027
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=j2ee_services\n218=J2EE services\n219=websvc.kncorp.group.local;J2EE - _WiringPdfDataSheet_WS_ URL Status\n219=websvc.kncorp.group.local;J2EE - _WiringPdfDataSheet_WS_ URL Content\n219=websvc.kncorp.group.local;J2EE - _WiringPdfD"..., 11169) = 11169
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=mail-services\n218=Email Services\n219=mr2.krausnaimer.com;SMTP Service\n219=mr1.krausnaimer.com;SMTP Service\n219=mail.kncorp.group.local;IMAP Service\n219=mail.kncorp.group.local;POP Service\n219=mail.kncorp.group.local;SMTP Serv"..., 563) = 563
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=opahas-processes\n218=OPAHAS Processes\n219=kdcv03.kncorp.group.local;OPAHAS_KNA process running\n219=kdcv03.kncorp.group.local;OPAHAS_AMS process running\n219=kdcv02.kncorp.group.local;OPAHAS_SIS process running\n219=kdcv02.kncor"..., 1099) = 1099
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=oracle-services\n218=Oracle Services\n219=kdc062.kncorp.group.local;ORA listener LISTENER_EXT_2 - tns check\n219=kdc062.kncorp.group.local;ORA listener LISTENER_EXT_2 - process\n219=kdc062.kncorp.group.local;ORA listener LISTENER"..., 10882) = 10882
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=time-checks\n218=Time Variance Checks\n219=kdc062.kncorp.group.local;Time Variance\n219=kdcweb301.kncorp.group.local;Time Variance\n219=kdc012.kncorp.group.local;Time Variance\n219=kdcoms101.kncorp.group.local;Time Variance\n219=au"..., 2359) = 2359
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=ts_active_sessions\n218=Terminal Server Active Sessions\n219=knw016.kncorp.group.local;Terminal Services Active Sessions\n219=sis013.kncorp.group.local;Terminal Services Active Sessions\n219=knw416.kncorp.group.local;Terminal Ser"..., 1178) = 1178
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=vmware-vdp-mails\n218=VMware Data Protection Mail Checks\n999\n\n", 91) = 91
[pid  4736] write(13, "\n403:\n4=1484744447.843712\n220=zypper-checks\n218=Zypper Update Checks\n219=kdc062.kncorp.group.local;Zypper Updates\n219=kdcweb301.kncorp.group.local;Zypper Updates\n219=kdc012.kncorp.group.local;Zypper Updates\n219=kdcoms101.kncorp.group.local;Zypper Updates\n"..., 2272) = 2272
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=0\237\361\n136=\30\342\330\314?\n137=\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 105) = 105
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=1\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] write(13, "\n405:\n4=1484744447.843712\n174=\250\341\330\314?\n210=\30\342\330\314?\n136=0\237\361\n137=\320\323\272\n135=2\n181=1\n259=\n148=0\n152=0\n149=1\n146=1\n999\n\n", 108) = 108
[pid  4736] --- SIGSEGV {si_signo=SIGSEGV, si_code=SEGV_MAPERR, si_addr=0x157a000} ---
[pid  4742] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid  4741] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid  4740] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid  4738] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid  4739] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid  4737] <... epoll_wait resumed> {{EPOLLIN|EPOLLHUP|EPOLLRDHUP, {u32=3, u64=3}}}, 1, -1) = 1
[pid  4741] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid  4738] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid  4736] +++ killed by SIGSEGV (core dumped) +++
[pid  4739] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid  4737] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid  4741] <... mmap resumed> )        = 0x7f2b2a740000
[pid  4739] <... mmap resumed> )        = 0x7f3533a78000
[pid  4738] <... mmap resumed> )        = 0x7fba2c5fd000
[pid  4737] <... mmap resumed> )        = 0x7ff64bc93000
[pid  4741] read(3,  <unfinished ...>
[pid  4739] read(3,  <unfinished ...>
[pid  4741] <... read resumed> "", 524288) = 0
[pid  4738] read(3,  <unfinished ...>
[pid  4739] <... read resumed> "", 524288) = 0
[pid  4737] read(3,  <unfinished ...>
[pid  4741] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid  4738] <... read resumed> "", 524288) = 0
[pid  4741] <... epoll_ctl resumed> )   = 0
[pid  4739] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid  4737] <... read resumed> "", 524288) = 0
[pid  4741] close(3 <unfinished ...>
[pid  4739] <... epoll_ctl resumed> )   = 0
[pid  4738] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid  4741] <... close resumed> )       = 0
[pid  4739] close(3 <unfinished ...>
[pid  4742] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid  4741] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4740] mmap(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 <unfinished ...>
[pid  4739] <... close resumed> )       = 0
[pid  4741] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4739] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4741] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4739] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4741] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4739] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4741] kill(0, SIGTERM <unfinished ...>
[pid  4739] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4741] <... kill resumed> )        = 0
[pid  4739] kill(0, SIGTERM <unfinished ...>
[pid  4741] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=4741, si_uid=500} ---
[pid  4739] <... kill resumed> )        = 0
[pid  4742] <... mmap resumed> )        = 0x7f1edb017000
[pid  4741] wait4(-1,  <unfinished ...>
[pid  4740] <... mmap resumed> )        = 0x7faf946b7000
[pid  4739] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=4739, si_uid=500} ---
[pid  4741] <... wait4 resumed> 0x7ffc7310133c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4739] wait4(-1,  <unfinished ...>
[pid  4741] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4739] <... wait4 resumed> 0x7ffeee424e2c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4741] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4739] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4741] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4739] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4741] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4739] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4741] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4739] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4741] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4739] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4741] nanosleep({1, 0},  <unfinished ...>
[pid  4739] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4739] nanosleep({1, 0},  <unfinished ...>
[pid  4740] read(3,  <unfinished ...>
[pid  4742] read(3, "", 524288)         = 0
[pid  4740] <... read resumed> "", 524288) = 0
[pid  4738] <... epoll_ctl resumed> )   = 0
[pid  4742] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid  4740] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid  4738] close(3 <unfinished ...>
[pid  4742] <... epoll_ctl resumed> )   = 0
[pid  4740] <... epoll_ctl resumed> )   = 0
[pid  4738] <... close resumed> )       = 0
[pid  4738] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4742] close(3 <unfinished ...>
[pid  4740] close(3 <unfinished ...>
[pid  4738] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4742] <... close resumed> )       = 0
[pid  4740] <... close resumed> )       = 0
[pid  4742] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4740] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4738] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4740] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4742] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4738] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4740] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4742] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4738] kill(0, SIGTERM <unfinished ...>
[pid  4740] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4742] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4738] <... kill resumed> )        = 0
[pid  4740] kill(0, SIGTERM <unfinished ...>
[pid  4742] kill(0, SIGTERM <unfinished ...>
[pid  4738] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=4738, si_uid=500} ---
[pid  4742] <... kill resumed> )        = 0
[pid  4740] <... kill resumed> )        = 0
[pid  4738] wait4(-1,  <unfinished ...>
[pid  4737] epoll_ctl(4, EPOLL_CTL_DEL, 3, {0x80000 /* EPOLL??? */, {u32=0, u64=0}} <unfinished ...>
[pid  4742] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=4742, si_uid=500} ---
[pid  4738] <... wait4 resumed> 0x7ffe6a73f83c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4737] <... epoll_ctl resumed> )   = 0
[pid  4742] wait4(-1,  <unfinished ...>
[pid  4738] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4742] <... wait4 resumed> 0x7ffc7e5fe8ec, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4737] close(3 <unfinished ...>
[pid  4738] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4737] <... close resumed> )       = 0
[pid  4742] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4738] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4737] rt_sigaction(SIGTERM, {SIG_IGN, [TERM], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4742] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4738] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4737] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4742] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4738] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4737] rt_sigaction(SIGSEGV, {SIG_IGN, [SEGV], SA_RESTORER|SA_RESTART, 0x3fcca32660},  <unfinished ...>
[pid  4742] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4738] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4742] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4737] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
[pid  4738] nanosleep({1, 0},  <unfinished ...>
[pid  4742] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4737] kill(0, SIGTERM <unfinished ...>
[pid  4742] nanosleep({1, 0},  <unfinished ...>
[pid  4737] <... kill resumed> )        = 0
[pid  4740] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=4740, si_uid=500} ---
[pid  4737] --- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=4737, si_uid=500} ---
[pid  4740] wait4(-1,  <unfinished ...>
[pid  4737] wait4(-1,  <unfinished ...>
[pid  4740] <... wait4 resumed> 0x7ffc544b89cc, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4737] <... wait4 resumed> 0x7ffea99aaa7c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4740] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4737] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4740] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4737] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4740] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4737] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4740] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4737] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4740] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4737] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4740] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4737] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4740] nanosleep({1, 0},  <unfinished ...>
[pid  4737] nanosleep({1, 0},  <unfinished ...>
[pid  4741] <... nanosleep resumed> 0x7ffc731012f0) = 0
[pid  4739] <... nanosleep resumed> 0x7ffeee424de0) = 0
[pid  4739] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4741] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4739] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4741] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4739] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4741] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4739] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4741] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4739] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4741] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4739] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4741] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4739] nanosleep({1, 0},  <unfinished ...>
[pid  4741] nanosleep({1, 0},  <unfinished ...>
[pid  4742] <... nanosleep resumed> 0x7ffc7e5fe8a0) = 0
[pid  4738] <... nanosleep resumed> 0x7ffe6a73f7f0) = 0
[pid  4742] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4738] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4742] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4742] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4738] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4742] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4738] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4742] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4738] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4742] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4738] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4742] nanosleep({1, 0},  <unfinished ...>
[pid  4737] <... nanosleep resumed> 0x7ffea99aaa30) = 0
[pid  4740] <... nanosleep resumed> 0x7ffc544b8980) = 0
[pid  4738] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4737] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4738] nanosleep({1, 0},  <unfinished ...>
[pid  4740] rt_sigprocmask(SIG_BLOCK, [CHLD],  <unfinished ...>
[pid  4737] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4740] <... rt_sigprocmask resumed> [], 8) = 0
[pid  4737] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4740] rt_sigaction(SIGCHLD, NULL,  <unfinished ...>
[pid  4737] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4740] <... rt_sigaction resumed> {0x4737b0, [CHLD], SA_RESTORER|SA_RESTART, 0x3fcca32660}, 8) = 0
[pid  4737] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4740] rt_sigprocmask(SIG_SETMASK, [],  <unfinished ...>
[pid  4737] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4740] <... rt_sigprocmask resumed> NULL, 8) = 0
[pid  4737] nanosleep({1, 0},  <unfinished ...>
[pid  4740] nanosleep({1, 0},  <unfinished ...>
[pid  4741] <... nanosleep resumed> 0x7ffc731012f0) = 0
[pid  4739] <... nanosleep resumed> 0x7ffeee424de0) = 0
[pid  4741] wait4(-1,  <unfinished ...>
[pid  4739] wait4(-1,  <unfinished ...>
[pid  4741] <... wait4 resumed> 0x7ffc7310133c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4739] <... wait4 resumed> 0x7ffeee424e2c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4741] exit_group(0)               = ?
[pid  4739] exit_group(0)               = ?
[pid  4741] +++ exited with 0 +++
[pid  4739] +++ exited with 0 +++
[pid  4742] <... nanosleep resumed> 0x7ffc7e5fe8a0) = 0
[pid  4738] <... nanosleep resumed> 0x7ffe6a73f7f0) = 0
[pid  4742] wait4(-1,  <unfinished ...>
[pid  4738] wait4(-1,  <unfinished ...>
[pid  4742] <... wait4 resumed> 0x7ffc7e5fe8ec, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4738] <... wait4 resumed> 0x7ffe6a73f83c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4742] exit_group(0)               = ?
[pid  4740] <... nanosleep resumed> 0x7ffc544b8980) = 0
[pid  4738] exit_group(0)               = ?
[pid  4737] <... nanosleep resumed> 0x7ffea99aaa30) = 0
[pid  4740] wait4(-1,  <unfinished ...>
[pid  4742] +++ exited with 0 +++
[pid  4740] <... wait4 resumed> 0x7ffc544b89cc, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4738] +++ exited with 0 +++
[pid  4737] wait4(-1,  <unfinished ...>
[pid  4740] exit_group(0)               = ?
[pid  4737] <... wait4 resumed> 0x7ffea99aaa7c, WNOHANG, NULL) = -1 ECHILD (No child processes)
[pid  4737] exit_group(0)               = ?
[pid  4740] +++ exited with 0 +++
+++ exited with 0 +++
Segmentation fault (core dumped)
[nagios@kdc004 ~]$

tmcdonald · Post by **tmcdonald** » Wed Jan 18, 2017 6:05 pm

If you disable the host you added, does the behavior go back to normal? I have another customer right now with a 5.4.0 segfault issue and I am trying to find any common factors. I had a theory that it was a config file causing the other issue, so if removing yours does in fact fix it then we might be on the right track.

comsupport · Post by **comsupport** » Thu Jan 19, 2017 3:02 am

Yes, sometimes it helps removing the etc/services/<hostname> file that was last changed.
Sometime we had to restore a configuration-snapshot in the NagiosXI CCM.
We also had the case that we had to go 2-3 snapshots back until the nagios-core process started to work again.

tmcdonald · Post by **tmcdonald** » Thu Jan 19, 2017 2:15 pm

If you can identify which host/service is causing issues, please PM it to me so I can look it over. We have not been able to replicate this issue internally.

comsupport · Post by **comsupport** » Fri Jan 20, 2017 5:13 am

We cannot replicate it either, because it fails on different hosts and/or service changes.

When it fails I retry the start of nagios several times over the UI, then from the command line with:
/usr/local/nagios/bin/nagios /usr/local/nagios/etc/nagios.cfg

Yesterday it failed on the command line 3-4 times and then it worked

tmcdonald · Post by **tmcdonald** » Fri Jan 20, 2017 3:06 pm

Can you open an email ticket for this? We might need to either do a remote or get sensitive/large files for review. Email [email protected] and we'll pick up there.

comsupport · Post by **comsupport** » Tue Jan 24, 2017 8:27 am

We have removed about 20 obsolete hosts and about 200 services from the configuration.
Now we can add/reenable all new services and hosts without any problems.

tmcdonald · Post by **tmcdonald** » Tue Jan 24, 2017 10:22 am

As we believe this segfault issue to be related to specific host/service configs, would it be possible for us to get a copy of the offending configs for review? There are a few other users seeing this issue and removing checks seems to help, but we need to look for a pattern in the config files to determine the root of the problem.

Nagios Support Forum

NagiosCore Segmentation Fault after adding host-checks

NagiosCore Segmentation Fault after adding host-checks

Re: NagiosCore Segmentation Fault after adding host-checks

Re: NagiosCore Segmentation Fault after adding host-checks

Re: NagiosCore Segmentation Fault after adding host-checks

Re: NagiosCore Segmentation Fault after adding host-checks

Re: NagiosCore Segmentation Fault after adding host-checks

Re: NagiosCore Segmentation Fault after adding host-checks

Re: NagiosCore Segmentation Fault after adding host-checks

Re: NagiosCore Segmentation Fault after adding host-checks

Re: NagiosCore Segmentation Fault after adding host-checks