NagiosXI apply configuration endless state

[anish]

NagiosXI - 5.3.2
Template build

Error : Configuration not applied. There are changes to the database configuration, apply configuration needed.

When I apply configuration it just goes into endless state.

Rebooted a couple of times.

It was upgraded from 5.2.9 to 5.3.2.

[anish]

Apart from a few warnings the config check works fine from the CLI

Code: Select all

[root@SESKLNGCOREDV01 nagios]# /usr/local/nagios/bin/nagios -v /usr/local/nagios/etc/nagios.cfg

Nagios Core 4.1.1
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 08-19-2015
License: GPL

Website: https://www.nagios.org
Reading configuration data...
   Read main config file okay...
Warning: Duplicate definition found for service 'JBOSS_Service' on host 'seskwpasjbprd03' (config file '/usr/local/nagios/etc/services/JBOSS_Service.cfg', starting on line 16)
Warning: Duplicate definition found for service 'JBOSS_Service' on host 'seskwpasjbprd04' (config file '/usr/local/nagios/etc/services/JBOSS_Service.cfg', starting on line 16)
Warning: Duplicate definition found for service 'JBOSS_Service' on host 'seskwpasjbprd05' (config file '/usr/local/nagios/etc/services/JBOSS_Service.cfg', starting on line 16)
Warning: Duplicate definition found for service 'JBOSS_Service' on host 'SESKWPASXv14' (config file '/usr/local/nagios/etc/services/JBOSS_Service.cfg', starting on line 16)
Warning: Duplicate definition found for service 'Ping' on host 'SESKWCT0003' (config file '/usr/local/nagios/etc/services/SESKWCT0003.cfg', starting on line 80)
Warning: Duplicate definition found for service 'Ping' on host 'sesklairicedev01.emea.astrazeneca.net' (config file '/usr/local/nagios/etc/services/sesklairicedev01.emea.astrazeneca.net.cfg', starting on line 112)
Warning: Duplicate definition found for service 'JBOSS_Service' on host 'SESKWCT0005' (config file '/usr/local/nagios/etc/services/JBOSS_Service_DEV.cfg', starting on line 16)
Warning: Duplicate definition found for service 'Ping' on host 'sesoxval23' (config file '/usr/local/nagios/etc/services/10.54.79.214.cfg', starting on line 96)
Warning: Duplicate definition found for service 'Ping' on host 'SESOXPRO40' (config file '/usr/local/nagios/etc/services/SESOXPRO40.cfg', starting on line 464)
   Read object config files okay...

Running pre-flight check on configuration data...

Checking objects...
        Checked 365 services.
        Checked 29 hosts.
        Checked 10 host groups.
        Checked 1 service groups.
        Checked 16 contacts.
        Checked 2 contact groups.
        Checked 126 commands.
        Checked 22 time periods.
        Checked 0 host escalations.
        Checked 0 service escalations.
Checking for circular paths...
        Checked 29 hosts
        Checked 0 service dependencies
        Checked 0 host dependencies
        Checked 22 timeperiods
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...

Total Warnings: 0
Total Errors:   0

Things look okay - No serious problems were detected during the pre-flight check

[dwhitfield]

Can you post the output of ls -la /usr/local/nagios/etc/services? My guess is you have a duplicate file...possibly one with uppercase and one with lowercase.

[anish]

Doesn't look like

Code: Select all

[root@SESKLNGCOREDV01 ~]# ls -la /usr/local/nagios/etc/services
total 316
drwsrwsr-x 2 apache nagios  4096 Nov  7 17:57 .
drwsrwsr-x 7 apache nagios  4096 Nov  7 16:04 ..
-rw-r--r-- 1 apache nagios  3923 Nov  7 17:57 10.54.79.214.cfg
-rw-r--r-- 1 apache nagios  1383 Nov  7 17:57 Citrix_CitrixWMIService_Service.cfg
-rw-r--r-- 1 apache nagios  1380 Nov  7 17:57 Citrix_CitrixXTEServer_Service.cfg
-rw-r--r-- 1 apache nagios  1349 Nov  7 17:57 Citrix_cpsvc_Service.cfg
-rw-r--r-- 1 apache nagios  1410 Nov  7 17:57 Citrix_FirebirdServerCSMInstance_Service.cfg
-rw-r--r-- 1 apache nagios  1365 Nov  7 17:57 Citrix_IMAService_Service.cfg
-rw-r--r-- 1 apache nagios  1350 Nov  7 17:57 Citrix_MFCom_Service.cfg
-rw-r--r-- 1 apache nagios  1309 Nov  7 17:57 Citrix_PVS_Print_Manager_Service.cfg
-rw-r--r-- 1 apache nagios  1300 Nov  7 17:57 Citrix_PVS_TFTP_Service.cfg
-rw-r--r-- 1 apache nagios  1359 Nov  7 17:57 Citrix_RSCorSvc_Service.cfg
-rw-r--r-- 1 apache nagios  1306 Nov  7 17:57 Citrix_SOAPServer.cfg
-rw-r--r-- 1 apache nagios  1304 Nov  7 17:57 Citrix_Steam_Service.cfg
-rw-r--r-- 1 apache nagios   984 Nov  7 17:57 CPU_Stats_NRPE_Linux.cfg
-rw-r--r-- 1 apache nagios  1294 Nov  7 17:57 CPU_Usage_Windows.cfg
-rw-r--r-- 1 apache nagios   993 Nov  7 17:57 cron_process_linux.cfg
-rw-r--r-- 1 apache nagios   993 Nov  7 17:57 Drive_check_NRPE_Linux.cfg
-rw-r--r-- 1 apache nagios  1260 Nov  7 17:57 Drive_check_NSClient.cfg
-rw-r--r-- 1 apache nagios  1437 Nov  7 17:57 JBOSS_Service.cfg
-rw-r--r-- 1 apache nagios  1437 Nov  7 17:57 JBOSS_Service_DEV.cfg
-rw-r--r-- 1 apache nagios   993 Nov  7 17:57 Load_NRPE_Linux.cfg
-rw-r--r-- 1 apache nagios  2962 Nov  7 17:57 localhost.cfg
-rw-r--r-- 1 apache nagios   988 Nov  7 17:57 Memory_Usage_NRPE_Linux.cfg
-rw-r--r-- 1 apache nagios  1305 Nov  7 17:57 Memory_Usage_Windows.cfg
-rw-r--r-- 1 apache nagios  1275 Nov  7 17:57 MSSQLSERVER_Service.cfg
-rw-r--r-- 1 apache nagios  1302 Nov  7 17:57 MSSSQLSERVER_ALTIRIS71_Service.cfg
-rw-r--r-- 1 apache nagios   991 Nov  7 17:57 ntpd_process_linux.cfg
-rw-r--r-- 1 apache nagios  1064 Nov  7 17:57 Physical_Memory_Windows.cfg
-rw-r--r-- 1 apache nagios  1140 Nov  7 17:57 ping.cfg
-rw-r--r-- 1 apache nagios  7583 Nov  7 17:57 SEMLSARDPD01.cfg
-rw-r--r-- 1 apache nagios  9628 Nov  7 17:57 SEMLSITPPR01.cfg
-rw-r--r-- 1 apache nagios  5794 Nov  7 17:57 sesklairicedev01.emea.astrazeneca.net.cfg
-rw-r--r-- 1 apache nagios  8359 Nov  7 17:57 SESKSAZUREDEV01.cfg
-rw-r--r-- 1 apache nagios 28607 Nov  7 17:57 SESKSAZUREPD01.cfg
-rw-r--r-- 1 apache nagios  8399 Nov  7 17:57 SESKSPVIORA006.cfg
-rw-r--r-- 1 apache nagios  5023 Nov  7 17:57 SESKSSAPDA28.cfg
-rw-r--r-- 1 apache nagios  5061 Nov  7 17:57 SESKSVZORA003.cfg
-rw-r--r-- 1 apache nagios  6345 Nov  7 17:57 SESKSVZORA005.cfg
-rw-r--r-- 1 apache nagios  3333 Nov  7 17:57 SESKWCT0003.cfg
-rw-r--r-- 1 apache nagios  6270 Nov  7 17:57 SESOSAPACPRD01.cfg
-rw-r--r-- 1 apache nagios  5439 Nov  7 17:57 SESOSVZORA001.cfg
-rw-r--r-- 1 apache nagios 13228 Nov  7 17:57 SESOXPRO40.cfg
-rw-r--r-- 1 apache nagios  1377 Nov  7 17:57 SharePoint Administration Service.cfg
-rw-r--r-- 1 apache nagios  1390 Nov  7 17:57 SharePoint search host controller.cfg
-rw-r--r-- 1 apache nagios  1369 Nov  7 17:57 SharePoint Search Service.cfg
-rw-r--r-- 1 apache nagios  1368 Nov  7 17:57 Sharepoint Timer Service.cfg
-rw-r--r-- 1 apache nagios  1298 Nov  7 17:57 SQLAgent_ALTIRIS71_Service.cfg
-rw-r--r-- 1 apache nagios  1299 Nov  7 17:57 SQLAgent_MSSQLSERVER_Service.cfg
-rw-r--r-- 1 apache nagios   970 Nov  7 17:57 SSH_Daemon_NRPE_Linux.cfg
-rw-r--r-- 1 apache nagios   984 Nov  7 17:57 Swap_Usage_NRPE_Linux.cfg
-rw-r--r-- 1 apache nagios  1362 Nov  7 17:57 Trace code service.cfg
-rw-r--r-- 1 apache nagios  1229 Nov  7 17:57 Uptime_NSClient.cfg
-rw-r--r-- 1 apache nagios  1877 Nov  7 17:57 uscvljsjsdbdev01.americas.astrazeneca.net.cfg
-rw-r--r-- 1 apache nagios  1359 Nov  7 17:57 Workstation_service.cfg
-rw-r--r-- 1 apache nagios  1362 Nov  7 17:57 World Wide WEB service.cfg
-rw-r--r-- 1 apache nagios   995 Nov  7 17:57 xinted_process_linux.cfg

[dwhitfield]

It is really weird that this happened on upgrade, but most often this type of behavior can be attributed to a hostgroup and/or servicegroup memerbship. If you have checks set up directly for the host in the host's config, be careful that the host is not also inheriting checks from a hostgroup or servicegroup with the same checks configured.

Can you PM me your profile? Admin->System Profile->Download Profile

EDIT: Profiled received and shared with techs.

[dwhitfield]

Can you run curl -s http://assets.nagios.com/downloads/nagi ... tic_import| mysql -pnagiosxi nagiosql and let us know if that fixes your issue? Thanks!

Looks like you'll have to pull out the script URL since it is truncating automatically.

[anish]

sorry the nagiosxi servers are in a disconnected network.

I tried to get the link but it says not found.

[avandemore]

XI > Configure > Core Config Manager > Config File Management > Delete Files > Write Configs > Verify Files > Restart Nagios Core

Let us know the result.

[anish]

Tried that.. it runs into an endless state.

[avandemore]

Can you post the output from this?

Code: Select all

# su - nagios
$ cd /usr/local/nagiosxi/scripts/
$ /usr/local/nagiosxi/scripts/reconfigure_nagios.sh