Nagios does not recognize that it has applied config
Posted: Tue Feb 19, 2019 10:04 am
CentOS Linux release 7.6.1810 (Core)
3.10.0-957.1.3.el7.x86_64
Nagios XI 5.5.7
Manual Install
This morning Nagios started behaving strangely. We updated hosts via the API (/nagiosxi/api/v1/config/host) and attempted to apply configuration. Nagios has successfully updated the correct host files, but the CCM still shows that the configuration needs to be applied:
When applying the configuration everything seems to work:
The host files in /usr/local/nagios/etc/hosts were updated correctly.
I did notice a problem when tailing /usr/local/nagiosxi/var/cmdsubsys.log, but I am not sure if this is an existing error:
The Nagios Core service is running:
Also, the ndo2db service is running:
The system, PHP, and MySQL times seem to be synced (this solution was proposed here https://support.nagios.com/forum/viewto ... 16&t=41725):
3.10.0-957.1.3.el7.x86_64
Nagios XI 5.5.7
Manual Install
This morning Nagios started behaving strangely. We updated hosts via the API (/nagiosxi/api/v1/config/host) and attempted to apply configuration. Nagios has successfully updated the correct host files, but the CCM still shows that the configuration needs to be applied:
When applying the configuration everything seems to work:
The host files in /usr/local/nagios/etc/hosts were updated correctly.
I did notice a problem when tailing /usr/local/nagiosxi/var/cmdsubsys.log, but I am not sure if this is an existing error:
Code: Select all
> Verifying configuration with Nagios Core
> Output:
Nagios Core 4.4.2
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 2018-08-16
License: GPL
Website: https://www.nagios.org
Reading configuration data...
Read main config file okay...
Read object config files okay...
Running pre-flight check on configuration data...
Checking objects...
Checked 2959 services.
Checked 3006 hosts.
Checked 2172 host groups.
Checked 4 service groups.
Checked 38 contacts.
Checked 40 contact groups.
Checked 128 commands.
Checked 42 time periods.
Checked 0 host escalations.
Checked 0 service escalations.
Checking for circular paths...
Checked 3006 hosts
Checked 0 service dependencies
Checked 0 host dependencies
Checked 42 timeperiods
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...
Total Warnings: 0
Total Errors: 0
Things look okay - No serious problems were detected during the pre-flight check
> Return Code: 0
--------------------------------------
.OUTPUT=--------------------------------------
RETURNCODE=0
.
PROCESSED 1 COMMANDS
PROCESSING COMMAND ID 13083...
PROCESS COMMAND: CMD=1150, DATA=remove
CMDLINE=php /usr/local/nagiosxi/html/includes/components/nagiosbpi/api_tool.php --cmd=syncall
...............................PHP Notice: Undefined variable: err in /usr/local/nagiosxi/html/includes/components/nagiosbpi/api_tool.php on line 146
CMD: syncall
MSG: Could not get data for objects. NDO or Core may not be running.
OUTPUT=MSG: Could not get data for objects. NDO or Core may not be running.
RETURNCODE=0
Code: Select all
● nagios.service - Nagios Core 4.4.2
Loaded: loaded (/usr/lib/systemd/system/nagios.service; enabled; vendor preset: disabled)
Active: active (running) since Tue 2019-02-19 09:54:28 EST; 4min 15s ago
Docs: https://www.nagios.org/documentation
Process: 3631 ExecStopPost=/bin/rm -f /usr/local/nagios/var/rw/nagios.cmd (code=exited, status=0/SUCCESS)
Process: 3628 ExecStop=/bin/kill -s TERM ${MAINPID} (code=exited, status=0/SUCCESS)
Process: 3636 ExecStart=/usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg (code=exited, status=0/SUCCESS)
Process: 3634 ExecStartPre=/usr/local/nagios/bin/nagios -v /usr/local/nagios/etc/nagios.cfg (code=exited, status=0/SUCCESS)
Main PID: 3638 (nagios)
CGroup: /system.slice/nagios.service
├─3638 /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg
├─3639 /usr/local/nagios/bin/nagios --worker /usr/local/nagios/var/rw/nagios.qh
├─3640 /usr/local/nagios/bin/nagios --worker /usr/local/nagios/var/rw/nagios.qh
├─3641 /usr/local/nagios/bin/nagios --worker /usr/local/nagios/var/rw/nagios.qh
├─3642 /usr/local/nagios/bin/nagios --worker /usr/local/nagios/var/rw/nagios.qh
├─3643 /usr/local/nagios/bin/nagios --worker /usr/local/nagios/var/rw/nagios.qh
├─3644 /usr/local/nagios/bin/nagios --worker /usr/local/nagios/var/rw/nagios.qh
├─3718 /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg
├─6244 /usr/local/nagios/libexec/check_icmp -H 172.24.80.229 -w 3000.0 80 -c 5000.0 100 -p 5
├─6247 /usr/local/nagios/libexec/check_icmp -H 172.31.254.8 -w 3000.0 80 -c 5000.0 100 -p 5
└─6258 /usr/local/nagios/libexec/check_icmp -H 172.31.250.7 -w 3000.0 80 -c 5000.0 100 -p 5
Code: Select all
● ndo2db.service - Nagios Data Out Daemon
Loaded: loaded (/usr/lib/systemd/system/ndo2db.service; enabled; vendor preset: disabled)
Active: active (running) since Tue 2019-02-19 09:01:22 EST; 58min ago
Docs: http://www.nagios.org/documentation
Process: 20916 ExecStopPost=/bin/rm -f /usr/local/nagios/var/ndo2db.lock (code=exited, status=0/SUCCESS)
Process: 20922 ExecStartPre=/bin/rm -f /usr/local/nagios/var/ndo.sock (code=exited, status=0/SUCCESS)
Process: 20920 ExecStartPre=/bin/rm -f /usr/local/nagios/var/ndo2db.lock (code=exited, status=0/SUCCESS)
Main PID: 20925 (ndo2db)
CGroup: /system.slice/ndo2db.service
├─ 3650 /usr/local/nagios/bin/ndo2db -c /usr/local/nagios/etc/ndo2db.cfg -f
├─ 3652 /usr/local/nagios/bin/ndo2db -c /usr/local/nagios/etc/ndo2db.cfg -f
└─20925 /usr/local/nagios/bin/ndo2db -c /usr/local/nagios/etc/ndo2db.cfg -f
Code: Select all
Tue Feb 19 10:00:45 EST 2019
Tue Feb 19 10:00:45 EST 2019
+---------------------+
| NOW() |
+---------------------+
| 2019-02-19 10:00:45 |
+---------------------+
