Nagios Service periodically crashing
Posted: Mon Jul 02, 2018 3:15 pm
We have been running XI stably for quite some time. We have noticed the nagios service is periodically crashing. I can't find anything in the logs that would explain why it is crashing. Seems to happen 3 - 4 times throughout the day. Any ideas of where I could look for more information to troubleshoot this?
We have about 1800 hosts and 35000 services being monitored from this host.
This is all i see in the logs
[1530558167] Caught SIGTERM, shutting down...
[1530558168] Successfully shutdown... (PID=1969)
[1530558168] livestatus: Socket thread has terminated
[1530558168] Event broker module '/usr/lib/check_mk/livestatus.o' deinitialized successfully.
[1530558168] Event broker module '/usr/lib/mod_gearman/mod_gearman.o' deinitialized successfully.
[1530558168] ndomod: Shutdown complete.
[1530558168] Event broker module '/usr/local/nagios/bin/ndomod.o' deinitialized successfully.
[1530558170] Nagios 3.5.0 starting... (PID=17185)
[1530558170] Local time is Mon Jul 02 12:02:50 PDT 2018
[1530558170] LOG VERSION: 2.0
[1530558170] livestatus: Livestatus 1.2.2p2 by Mathias Kettner. Socket: '/usr/local/nagios/var/rw/live'
[1530558170] livestatus: Please visit us at http://mathias-kettner.de/
[1530558170] livestatus: Hint: please try out OMD - the Open Monitoring Distribution
[1530558170] livestatus: Please visit OMD at http://omdistro.org
[1530558170] livestatus: archive path /usr/local/nagios/var/archives
[1530558170] livestatus: Finished initialization. Further log messages go to /usr/local/nagios/var/livestatus.log
[1530558170] Event broker module '/usr/lib/check_mk/livestatus.o' initialized successfully.
[1530558170] mod_gearman: initialized version 1.3.8 (libgearman 0.25)
[1530558170] Event broker module '/usr/lib/mod_gearman/mod_gearman.o' initialized successfully.
[1530558170] ndomod: NDOMOD 1.5.2 (06-08-2012) Copyright (c) 2009 Nagios Core Development Team and Community Contributors
[1530558170] ndomod: Successfully connected to data sink. 0 queued items to flush.
[1530558170] Event broker module '/usr/local/nagios/bin/ndomod.o' initialized successfully.
We have about 1800 hosts and 35000 services being monitored from this host.
This is all i see in the logs
[1530558167] Caught SIGTERM, shutting down...
[1530558168] Successfully shutdown... (PID=1969)
[1530558168] livestatus: Socket thread has terminated
[1530558168] Event broker module '/usr/lib/check_mk/livestatus.o' deinitialized successfully.
[1530558168] Event broker module '/usr/lib/mod_gearman/mod_gearman.o' deinitialized successfully.
[1530558168] ndomod: Shutdown complete.
[1530558168] Event broker module '/usr/local/nagios/bin/ndomod.o' deinitialized successfully.
[1530558170] Nagios 3.5.0 starting... (PID=17185)
[1530558170] Local time is Mon Jul 02 12:02:50 PDT 2018
[1530558170] LOG VERSION: 2.0
[1530558170] livestatus: Livestatus 1.2.2p2 by Mathias Kettner. Socket: '/usr/local/nagios/var/rw/live'
[1530558170] livestatus: Please visit us at http://mathias-kettner.de/
[1530558170] livestatus: Hint: please try out OMD - the Open Monitoring Distribution
[1530558170] livestatus: Please visit OMD at http://omdistro.org
[1530558170] livestatus: archive path /usr/local/nagios/var/archives
[1530558170] livestatus: Finished initialization. Further log messages go to /usr/local/nagios/var/livestatus.log
[1530558170] Event broker module '/usr/lib/check_mk/livestatus.o' initialized successfully.
[1530558170] mod_gearman: initialized version 1.3.8 (libgearman 0.25)
[1530558170] Event broker module '/usr/lib/mod_gearman/mod_gearman.o' initialized successfully.
[1530558170] ndomod: NDOMOD 1.5.2 (06-08-2012) Copyright (c) 2009 Nagios Core Development Team and Community Contributors
[1530558170] ndomod: Successfully connected to data sink. 0 queued items to flush.
[1530558170] Event broker module '/usr/local/nagios/bin/ndomod.o' initialized successfully.