Waiting for configuration verification.....

[unitedtech]

All,

Am getting the dreaded "Waiting for configuration verification..." from within the UI when using bulk cloning wizard or the CCM to apply the configuration. This has been working for several years now across 3 OS upgrades.

XI Version 5.5.3
CentOS 7, 64bit

Long story short, something is causing the configuration files to not be written out properly. From missing the "max_check" in a new host, to missing all the parameters in a service cfg file.

Followed the advice here; https://support.nagios.com/kb/article/n ... es-34.html
but to no avail. Was not getting any of the errors that are in that document.

For example running this:

<snip>
su nagios
cd /usr/local/nagiosxi/scripts
./reconfigure_nagios.sh
</snip>

This completes just fine before I try to add a new host and new service.

In that light, here are some failure scenarios that I ran into while trying to make heads and tails of what is going on.

Scenario 1
==========
Add a new host with services via the bulk cloning wizard.
-The waiting for configuration verification hangs.
- run ./reconfigure_nagios.sh and get
"Error: Could not register service"
When I look at the config file for the services for that host, it is not complete. Meaning, this is what the cfg file entries look like:
define service {
host_name ServerName
service_description FriendlyServiceName1
register 1
}

define service {
host_name ServerName
service_description FriendlyServiceName2
register 1
}

If I delete the services from that host and then the host via the CCM, then run reconfigure_nagios.sh it passes.
<snip>
Checking misc settings...

Total Warnings: 0
Total Errors: 0

Things look okay - No serious problems were detected during the pre-flight check
> Return Code: 0
</snip>

Press Apply Configuration via the web ui, and it hangs.

Scenario 2
=========
Go into the CCM
Add a new host by copying another host.
Press apply config and it hangs
run ./reconfigure_nagios.sh and it passes

<snip>
Checking misc settings...

Total Warnings: 0
Total Errors: 0

Things look okay - No serious problems were detected during the pre-flight check
> Return Code: 0
</snip>

From within the CCM, copy a service from another host, change the config name to the new host. Went into manage hosts and changed the host to the new one.

Applied config from within the UI, hangs.

Ran reconfigure_nagios.sh and it passes.
<snip>
Checking misc settings...

Total Warnings: 0
Total Errors: 0

Things look okay - No serious problems were detected during the pre-flight check
> Return Code: 0
</snip>

Checked the host status detail and the service was correctly there for the host.

Scenario 3
=========
Using the same host that was added manually and committed using the reconfigure_nagios.sh script, attempted to add new service using the bulk cloning wizard. Added 1 service from the cloned from host. Used address,name,description for the fields.

Pressed finish and Waiting for configuration verification hung.

used the reconfigure script and got: Error: Could not register service
Same issue as scenario 1, the services were not written correctly.

===================
---What I have tried---
===================
1. Obvious reboot, many times.
2. checked space on the root drive, extended the volume; it has several hundred gigs avail.
3. rebuilt the postgres database
4. edited php.ini and increased the timeouts
5. upgraded to version 5.5.3 from 5.5.2
6. checked /etc/hosts

Some errors:
tail -f /var/log/httpd/error_log
Invalid argument supplied for foreach() in /usr/local/nagiosxi/html/includes/configwizards/bulkhostimport/bulkhostimport.inc.php

tail -f /usr/local/nagiosxi/var/cmdsubsys.log
PHP Warning: Invalid argument supplied for foreach() in /usr/local/nagiosxi/html/includes/components/nagiosim/nagiosim.inc.php on line 491

………...Am at a loss of where to go from here.

Thoughts from the peanut gallery?

Thanks in advance

[scottwilkerson]

Lets do the following:

from the command line

Code: Select all

rm -f /usr/local/nagios/etc/import/*
rm -f /usr/local/nagiosxi/scripts/reconfigure_nagios.lock

then, in the CCM -> Tools -> Config File Management
Click Delete Files
Click Write Files
Click Verify Files

If there are any errors, fix them, if there are no errors, run Apply Configuration from the UI.

[unitedtech]

Hi Scott

Thank you for the suggestion, it did not fix it though.

Steps:
1. ran
rm -f /usr/local/nagios/etc/import/*
rm -f /usr/local/nagiosxi/scripts/reconfigure_nagios.lock

2. From ccm, ran delete, then write then verify.

3. Removed the offending host services from within the ccm

4. From ccm, ran delete, then write then verify. no errors

5. tried to apply confing, same issue. waiting for config verification

6. ran
rm -f /usr/local/nagios/etc/import/*
rm -f /usr/local/nagiosxi/scripts/reconfigure_nagios.lock

7. From ccm, ran delete, then write then verify. No errors

8. tried to apply confing, same issue. waiting for config verification

Any other tricks?

For historical purposes, this instance of Nagios xi has been migrated twice. It started 5 years ago on CentOS 5 32bit and Nagios XI 4.

Then migrated to CentOS6 and upgraded to XI 5

Then migrated it to CentOS7. A few weeks ago, we upgraded to 5.5.2. Up until 5.5.2 we were always able to use the bulk clone wizard. (we have 1K objects, 90% of them all created using the bulk clone wizard)

I upgraded to 5.5.3 this week, hoping that it would fix the issue.

Thanks in advance

Michael

[scottwilkerson]

Do you have a current support contract? I'd like to assist you maybe with a remote session but we would need you to create a ticket here
https://support.nagios.com/tickets/

[unitedtech]

I hear ya, Am working on getting it. We had a maintenance only contract; have never needed support before.

Got the renewal invoice from sales yesterday, am trying to push it through accounting.

[scottwilkerson]

I hear ya, Am working on getting it. We had a maintenance only contract; have never needed support before.

Got the renewal invoice from sales yesterday, am trying to push it through accounting.

Sounds good

[unitedtech]

I ended up just building a new server and restoring my last good backup.

having build documents and backups is always a good thing.

It is working again on the new server on 5.5.2.

Thanks again for the help

[scottwilkerson]

I ended up just building a new server and restoring my last good backup.

having build documents and backups is always a good thing.

It is working again on the new server on 5.5.2.

Thanks again for the help

Glad to hear you are back up and running

Locking thread