Waiting for Configuration Verification

[glitchcowboy]

I can 'Write Config', 'Verify Config', and 'Restart Nagios', but 'Apply Configuration' just goes indefinitely at 'Waiting for Configuration Verification' followed by a very long train on dots............................................

I've tried /usr/local/nagiosxi/scripts/reset_config_perms and /usr/local/nagiosxi/scripts/reconfigure_nagios.sh

RHEL 7, Nagios 5.2.9

[rkennedy]

Can you please post a few things for us to look at?
- /var/log/httpd/error_log and /var/log/httpd/ssl_error_log - this should have a bit of debug.
- A screenshot of your Admin -> System Settings page
- A copy of your /etc/hosts file

Usually this is related to DNS on an internal call. Are you using SSL at all?

[glitchcowboy]

2016-07-27 09_37_23-Nagios XI - Administration.jpg

Code: Select all

 tail /var/log/httpd/error_log   
[Wed Jul 27 09:29:33.970572 2016] [:error] [pid 4867] [client 192.168.60.81:48105] PHP Notice:  Undefined index: pretty in /usr/local/nagiosxi/html/api/includes/utils.inc.php on line 100
[Wed Jul 27 09:30:24.067065 2016] [:error] [pid 20242] [client 172.17.1.228:56345] PHP Notice:  Undefined index: pretty in /usr/local/nagiosxi/html/api/includes/utils.inc.php on line 100
[Wed Jul 27 09:30:33.766226 2016] [:error] [pid 20242] [client 192.168.60.81:48582] PHP Notice:  Undefined index: pretty in /usr/local/nagiosxi/html/api/includes/utils.inc.php on line 100
[Wed Jul 27 09:31:24.064542 2016] [:error] [pid 6749] [client 172.17.1.228:57164] PHP Notice:  Undefined index: pretty in /usr/local/nagiosxi/html/api/includes/utils.inc.php on line 100
[Wed Jul 27 09:31:33.648766 2016] [:error] [pid 6749] [client 192.168.60.81:49072] PHP Notice:  Undefined index: pretty in /usr/local/nagiosxi/html/api/includes/utils.inc.php on line 100
[Wed Jul 27 09:32:24.334047 2016] [:error] [pid 28117] [client 172.17.1.228:57804] PHP Notice:  Undefined index: pretty in /usr/local/nagiosxi/html/api/includes/utils.inc.php on line 100
/usr/bin/php: symbol lookup error: /usr/bin/php: undefined symbol: rl_on_new_line
[Wed Jul 27 09:32:33.612397 2016] [:error] [pid 29291] [client 192.168.60.81:49504] PHP Notice:  Undefined index: pretty in /usr/local/nagiosxi/html/api/includes/utils.inc.php on line 100
[Wed Jul 27 09:33:24.047978 2016] [:error] [pid 12741] [client 172.17.1.228:58385] PHP Notice:  Undefined index: pretty in /usr/local/nagiosxi/html/api/includes/utils.inc.php on line 100
[Wed Jul 27 09:33:33.382872 2016] [:error] [pid 13065] [client 192.168.60.81:49922] PHP Notice:  Undefined index: pretty in /usr/local/nagiosxi/html/api/includes/utils.inc.php on line 100

Code: Select all

# tail /var/log/httpd/ssl_error_log  
[Tue Jul 26 10:21:47.245707 2016] [:error] [pid 18913] [client 172.16.200.182:44021] PHP Warning:  Division by zero in /usr/local/nagiosxi/html/includes/components/opscreen/merlin.php on line 185, referer: https://nag.local/nagiosxi/includes/components/opscreen/opscreen.php
[Tue Jul 26 10:21:47.254596 2016] [:error] [pid 18913] [client 172.16.200.182:44021] PHP Warning:  Division by zero in /usr/local/nagiosxi/html/includes/components/opscreen/merlin.php on line 187, referer: https://nag.local/nagiosxi/includes/components/opscreen/opscreen.php
[Wed Jul 27 07:36:39.415598 2016] [:error] [pid 4965] [client 172.16.200.182:52457] PHP Warning:  Division by zero in /usr/local/nagiosxi/html/includes/components/opscreen/merlin.php on line 185, referer: https://nag.local/nagiosxi/includes/components/opscreen/opscreen.php
[Wed Jul 27 07:36:39.415633 2016] [:error] [pid 4965] [client 172.16.200.182:52457] PHP Warning:  Division by zero in /usr/local/nagiosxi/html/includes/components/opscreen/merlin.php on line 187, referer: https://nag.local/nagiosxi/includes/components/opscreen/opscreen.php
[Wed Jul 27 07:48:42.341096 2016] [:error] [pid 4163] [client 172.16.200.182:53352] PHP Warning:  Division by zero in /usr/local/nagiosxi/html/includes/components/opscreen/merlin.php on line 142, referer: https://nag.local/nagiosxi/includes/components/opscreen/opscreen.php
[Wed Jul 27 07:48:42.341138 2016] [:error] [pid 4163] [client 172.16.200.182:53352] PHP Warning:  Division by zero in /usr/local/nagiosxi/html/includes/components/opscreen/merlin.php on line 144, referer: https://nag.local/nagiosxi/includes/components/opscreen/opscreen.php
[Wed Jul 27 07:48:42.366637 2016] [:error] [pid 4163] [client 172.16.200.182:53352] PHP Warning:  Division by zero in /usr/local/nagiosxi/html/includes/components/opscreen/merlin.php on line 185, referer: https://nag.local/nagiosxi/includes/components/opscreen/opscreen.php
[Wed Jul 27 07:48:42.366685 2016] [:error] [pid 4163] [client 172.16.200.182:53352] PHP Warning:  Division by zero in /usr/local/nagiosxi/html/includes/components/opscreen/merlin.php on line 187, referer: https://nag.local/nagiosxi/includes/components/opscreen/opscreen.php
[Wed Jul 27 07:50:21.435178 2016] [:error] [pid 5502] [client 172.16.200.182:53472] PHP Warning:  Division by zero in /usr/local/nagiosxi/html/includes/components/opscreen/merlin.php on line 185, referer: https://nag.local/nagiosxi/includes/components/opscreen/opscreen.php
[Wed Jul 27 07:50:21.435240 2016] [:error] [pid 5502] [client 172.16.200.182:53472] PHP Warning:  Division by zero in /usr/local/nagiosxi/html/includes/components/opscreen/merlin.php on line 187, referer: https://nag.local/nagiosxi/includes/components/opscreen/opscreen.php

Code: Select all

# cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

[lmiltchev]

Try increasing the values of:

Code: Select all

max_execution_time = 
max_input_time = 
memory_limit = 

in the "/etc/php.ini", and restart apache:

Code: Select all

service httpd restart

If this doesn't solve the issue, start a running tail on the "cmdsubsys.log":

Code: Select all

tail -f /usr/local/nagiosxi/var/cmdsubsys.log

Attempt to Apply Configuration from the web interface. After the browser has returned some output to the screen, press "Ctrl+c" to stop the log tail, and show us the output.

[glitchcowboy]

Doubled the first 2 and quadrupled the last one:

Code: Select all

max_execution_time = 60
max_input_time = 120
memory_limit = 512

No change in behavior, cmdsubsys.log logged this after 60 seconds or so:

Code: Select all

tail: /usr/local/nagiosxi/var/cmdsubsys.log: file truncated
/usr/bin/php: symbol lookup error: /usr/bin/php: undefined symbol: rl_on_new_line

[lmiltchev]

This is not the output I was hoping for.
Let's try something else. Run the following commands:

Code: Select all

su nagios
cd /usr/local/nagiosxi/scripts
./reconfigure_nagios.sh &> /tmp/reconfigure.txt

Wait until reconfigure script is done running, then post the "reconfigure.txt" file that was created in the "/tmp/" directory.

[glitchcowboy]

Code: Select all

/usr/bin/php: symbol lookup error: /usr/bin/php: undefined symbol: rl_on_new_line
NAGIOSQL LOGIN FAILED!

[lmiltchev]

We will need you to run a few more commands, and show the output:

Code: Select all

uname -a
cat /etc/*release
yum list installed | grep libedit
rpm -qa | grep "el[56]"

[glitchcowboy]

Using the password from /usr/local/nagiosxi/etc/components/ccm_config.inc.php I was able to see the database:

Code: Select all

# mysql -u nagiosql -h localhost -p
Enter password: 
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MariaDB connection id is 2987
Server version: 5.5.47-MariaDB MariaDB Server

Copyright (c) 2000, 2015, Oracle, MariaDB Corporation Ab and others.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

MariaDB [(none)]> use nagiosql
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Database changed
MariaDB [nagiosql]> show tables;
+--------------------------------------------+
| Tables_in_nagiosql                         |
+--------------------------------------------+
| tbl_command                                |
| tbl_contact                                |

[rkennedy]

Seeing the database isn't the issue currently, could you please run the 4 commands @lmiltchev posted and show us the output? We're wondering if it's your version of libedit.

Code: Select all

uname -a
cat /etc/*release
yum list installed | grep libedit
rpm -qa | grep "el[56]"

Additionally, looking at the screenshot for your System Settings page - can you update your /etc/hosts file so that the FQDN in use is fully resolvable? This will help us to make sure it isn't DNS related. For example, if under the scribbled text you had http://master.local/nagiosxi/, your FQDN would be 'master.local'. Add master.local under the 127.0.0.1 entry like this -

Code: Select all

127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4 master.local
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

Then, try again to apply configuration - let us know how it goes.