Nagios service goes into exited state after apply config

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
bsanjay
Posts: 86
Joined: Mon Apr 29, 2019 9:38 am

Re: Nagios service goes into exited state after apply config

Post by bsanjay »

Hello dchurch,
We executed the commands provided by you . We found nagios was not running today.
root@nagiosxidevenv:[~]: systemctl status nagios
● nagios.service - LSB: Starts and stops the Nagios monitoring server
Loaded: loaded (/etc/rc.d/init.d/nagios; bad; vendor preset: disabled)
Active: active (exited) since Tue 2021-03-16 11:52:35 EDT; 14h ago
Docs: man:systemd-sysv-generator(8)
Process: 14754 ExecStop=/etc/rc.d/init.d/nagios stop (code=exited, status=0/SUCCESS)
Process: 17164 ExecStart=/etc/rc.d/init.d/nagios start (code=exited, status=0/SUCCESS)
Tasks: 0

Mar 17 00:13:30 nagiosxidevenv.ux.corp.local nagios[17197]: wproc: Core Worker 17225: job 40292032 with pid 6846 reaped at timeout. timeouts=2; started=690
Mar 17 00:13:30 nagiosxidevenv.ux.corp.local nagios[17197]: wproc: Core Worker 17225: job 628 (pid=6851) timed out. Killing it
Mar 17 00:13:30 nagiosxidevenv.ux.corp.local nagios[17197]: wproc: GLOBAL HOST EVENTHANDLER job 628 from worker Core Worker 17225 is a non-check helper but exited with return code 1
Mar 17 00:13:30 nagiosxidevenv.ux.corp.local nagios[17208]: job 640 (pid=7902): read() returned error 11
Mar 17 00:13:30 nagiosxidevenv.ux.corp.local nagios[17197]: wproc: early_timeout=0; exited_ok=1; wait_status=256; error_code=0;
Mar 17 00:13:30 nagiosxidevenv.ux.corp.local nagios[17197]: wproc: stdout line 01: UNABLE TO CONNECT TO DB - EXITING!
Mar 17 00:13:30 nagiosxidevenv.ux.corp.local nagios[17197]: wproc: Core Worker 17225: job 40324400 with pid 6851 reaped at timeout. timeouts=3; started=690
Mar 17 00:13:30 nagiosxidevenv.ux.corp.local nagios[17197]: wproc: Core Worker 17225: job 629 (pid=6856) timed out. Killing it
Mar 17 00:13:30 nagiosxidevenv.ux.corp.local nagios[17197]: wproc: GLOBAL HOST EVENTHANDLER job 629 from worker Core Worker 17225 timed out after 43.77s
Mar 17 00:14:04 nagiosxidevenv.ux.corp.local nagios[17197]: Caught SIGSEGV, shutting down...
root@nagiosxidevenv:[~]:



Best Regards,
Bsanjay
dchurch
Posts: 858
Joined: Wed Oct 07, 2020 12:46 pm
Location: Yo mama

Re: Nagios service goes into exited state after apply config

Post by dchurch »

We've been having issues with NDO3 causing Nagios to segfault. We're still working on finding the root cause. The recommended remediation is to downgrade to NDO2DB for the time being.

STANDARD DOWNGRADE OF NDO3

Code: Select all

systemctl stop nagios
cd /tmp
rm -rf /tmp/nagiosxi
wget https://assets.nagios.com/downloads/nagiosxi/5/xi-5.6.14.tar.gz
tar zxf xi-5.6.14.tar.gz
cd /tmp/nagiosxi/subcomponents/ndoutils
./install
systemctl enable ndo2db
Then edit your /usr/local/nagios/etc/nagios.cfg and make sure this line is uncommented:

Code: Select all

broker_module=/usr/local/nagios/bin/ndomod.o config_file=/usr/local/nagios/etc/ndomod.cfg
Make sure this line is commented:

Code: Select all

#broker_module=/usr/local/nagios/bin/ndo.so /usr/local/nagios/etc/ndo.cfg
Then start the nagios service:

Code: Select all

systemctl start nagios
********************************************************************************

DOWNGRADE NDO WITH OFFLOADED DB

Code: Select all

service nagios stop
cd /tmp
rm -rf /tmp/nagiosxi
wget https://assets.nagios.com/downloads/nagiosxi/5/xi-5.6.14.tar.gz
tar zxf xi-5.6.14.tar.gz
cd /tmp/nagiosxi
If you have an offloaded DB you'll need to do these things:
  • Edit /tmp/nagiosxi/xi-sys.cfg and update 'mysqlpass' value.
  • Edit /tmp/nagiosxi/subcomponents/ndoutils/mods/cfg/ndo2db.cfg and update 'db_host', 'db_user', and 'db_pass' values.
  • Edit /tmp/nagiosxi/subcomponents/ndoutils/install and /tmp/nagiosxi/subcomponents/ndoutils/post-install to update all calls to mysql to include -h <db_ip>
Then continue as normal.

Code: Select all

cd /tmp/nagiosxi/subcomponents/ndoutils
./install
systemctl enable ndo2db
service ndo2db start
Then edit your /usr/local/nagios/etc/nagios.cfg and make sure this line is uncommented:

Code: Select all

broker_module=/usr/local/nagios/bin/ndomod.o config_file=/usr/local/nagios/etc/ndomod.cfg
Make sure this line is commented:

Code: Select all

#broker_module=/usr/local/nagios/bin/ndo.so /usr/local/nagios/etc/ndo.cfg
Then start the nagios service:

Code: Select all

systemctl start nagios
If you didn't get an 8% raise over the course of the pandemic, you took a pay cut.

Discussion of wages is protected speech under the National Labor Relations Act, and no employer can tell you you can't disclose your pay with your fellow employees.
bsanjay
Posts: 86
Joined: Mon Apr 29, 2019 9:38 am

Re: Nagios service goes into exited state after apply config

Post by bsanjay »

Hello dchurch,
I checked the ndo version and it shows below 3 version. Please find the screenshot attached. Do let me know if there is some other way to check the NDO version.

Best Regards,
bsanjay
You do not have the required permissions to view the files attached to this post.
dchurch
Posts: 858
Joined: Wed Oct 07, 2020 12:46 pm
Location: Yo mama

Re: Nagios service goes into exited state after apply config

Post by dchurch »

bsanjay wrote:I checked the ndo version and it shows below 3 version.
First, that's not what it shows in your screenshot.

Second, did you run into any issues downgrading from NDO3 to NDO2DB?
If you didn't get an 8% raise over the course of the pandemic, you took a pay cut.

Discussion of wages is protected speech under the National Labor Relations Act, and no employer can tell you you can't disclose your pay with your fellow employees.
Locked