After upgrade to 2012R2.1 "Apply Configuration" hangs

[nauessp]

Greetings and salutations,

After applying the 2012R2.1 update, clicking the "Apply Configuration" button results in a hang at "Waiting for configuration verification...".

Everything seems to be updated okay and both the "cmdsubsys.log" and the XI "Configuration Snapshots" look like everything was applied successfully. Anything I add, change, delete via the XI GUI shows up just fine.

This happened both on our production and development system after the 2012R2.1 upgrade. I've followed the directions at "http://support.nagios.com/wiki/index.ph ... n_Problems" and searched the forums. I've run "reset_config_perms", "reconfigure_nagios.sh", and even the "repairmysql.sh". All ran successfully but no change in behavior. (I even rebooted the server to no avail.)

We do use SSL, but I don't see anything in the Apache error_log or ssl_error_log. PHP settings are set to the recommended values from the FAQ. I even tried increasing them without luck. I've also tried various browsers (Firefox, Safari, and Chrome).

Any help would be appreciated. Here is the Admin->System Profile output from our production server:

Nagios XI Installation Profile

Download Profile
System:

Nagios XI Version : 2012R2.1
cobalt.ucc.nau.edu 2.6.18-348.6.1.el5xen x86_64
Red Hat Enterprise Linux Server release 5.9 (Tikanga)
Gnome Installed
Apache Information

PHP Version: 5.1.6
Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.93 Safari/537.36
Server Name: watcher.ucc.nau.edu
Server Address: 134.114.113.9
Server Port: 443
Date/Time

PHP Timezone: America/Phoenix
PHP Time: Tue, 28 May 2013 12:52:34 -0700
System Time: Tue, 28 May 2013 12:52:34 -0700
Nagios XI Data

nagios (pid 31091) is running...
NPCD running (pid 2589).
ndo2db (pid 7477) is running...
CPU Load 15: 0.70
Total Hosts: 317
Total Services: 2105
Function 'get_base_uri' returns: https://watcher.ucc.nau.edu/nagiosxi/
Function 'get_base_url' returns: https://watcher.ucc.nau.edu/nagiosxi/
Function 'get_backend_url(internal_call=false)' returns: https://watcher.ucc.nau.edu/nagiosxi/in ... rofile.php
Function 'get_backend_url(internal_call=true)' returns: https://localhost/nagiosxi/backend/
Ping Test localhost

Running:
/bin/ping -c 3 localhost 2>&1
PING localhost.localdomain (127.0.0.1) 56(84) bytes of data.
64 bytes from localhost.localdomain (127.0.0.1): icmp_seq=1 ttl=64 time=0.044 ms
64 bytes from localhost.localdomain (127.0.0.1): icmp_seq=2 ttl=64 time=0.059 ms
64 bytes from localhost.localdomain (127.0.0.1): icmp_seq=3 ttl=64 time=0.046 ms

--- localhost.localdomain ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 1998ms
rtt min/avg/max/mdev = 0.044/0.049/0.059/0.010 ms
Test wget To locahost

WGET From URL: https://localhost/nagiosql/index.php
Running:
/usr/bin/wget https://localhost/nagiosql/index.php
--2013-05-28 12:52:37-- https://localhost/nagiosql/index.php
Resolving localhost... 127.0.0.1
Connecting to localhost|127.0.0.1|:443... connected.
ERROR: certificate common name `watcher.ucc.nau.edu' doesn't match requested host name `localhost'.
To connect to localhost insecurely, use `--no-check-certificate'.
Unable to establish SSL connection.

[abrist]

Unable to establish SSL connection.

You may have an issue with ssl, lets check your config:

Code: Select all

grep https /usr/local/nagiosxi/html/config.inc.php

Also, go to --> Configure --> Core Config Manager --> Config Manager Admin --> Config Manager Settings.
Is https selected in the "Server Protocol" dropdown?

[nauessp]

# grep https /usr/local/nagiosxi/html/config.inc.php
$cfg['use_https']=true; //set this for true if you're using strict ssl

Also, the dropdown does have "https" selected.

I also have a feeling this may be SSL related... our apache config includes this setup (IPs changed to protect the innocent). We added the "localhost" exception last time there was an SSL issue:

# This redirects all http: to https: except for localhost connections.
RewriteCond %{HTTPS} !=on
RewriteCond %{HTTP_HOST} !localhost [NC]
RewriteCond %{HTTP_HOST} !123.123.123.123 [NC]
RewriteRule ^(.*) https://%{SERVER_NAME}$1 [R]

[abrist]

What hostname do you have set on the XI sever?

Code: Select all

hostname

[nauessp]

The hostname is "cobalt.ucc.nau.edu".

There is a CNAME for "cobalt.ucc.nau.edu" named "watcher.ucc.nau.edu" that is configured for the web server and is in the Nagios XI configuration in Admin --> Manage System Config in the "Program URL" box.

We don't force the "watcher" hostname in the Apache config or rewrite it if someone tries to go directly to the server. (However, they will get a certificate error if they do this.) We have our development box set up the same way, so I can try changing things if you think it would make a difference.

[sreinhardt]

Well it does specifically seem to be an issue with the certificate name being correct for external access and our scripts not ignoring this fact. Just to verify, have you followed our documentation for implementing ssl or just created the rewrite changes?

http://assets.nagios.com/downloads/nagi ... ios_XI.pdf

[nauessp]

I definitely used that document, or one a lot like it, a couple of years ago when I set up SSL.

I double checked everything I could find and even moved and re-created the nagiosxi.conf file. I also made sure the httpd.conf changes were all in place. I did spot a few differences and cleaned it all up and restarted apache. Besides pathing for the certificates and

No change in behavior. I also don't see anything in the error_logs except the restart messages. No change in the "System Profile" page (the "Test wget To locahost" is still failing).

I do see these in the access_log, but there is no indication they failed (in fact, there is no activity in the error_log when I click "Apply Configuration"):

127.0.0.1 - - [28/May/2013:16:33:16 -0700] "POST /nagiosql/index.php HTTP/1.0" 302 1027 "-" "Wget/1.11.4 Red Hat modified"
127.0.0.1 - - [28/May/2013:16:33:16 -0700] "GET /nagiosql/admin.php HTTP/1.0" 200 5286 "-" "Wget/1.11.4 Red Hat modified"
127.0.0.1 - - [28/May/2013:16:33:16 -0700] "POST /nagiosql/index.php HTTP/1.0" 302 1027 "-" "Wget/1.11.4 Red Hat modified"
127.0.0.1 - - [28/May/2013:16:33:16 -0700] "GET /nagiosql/admin.php HTTP/1.0" 200 5286 "-" "Wget/1.11.4 Red Hat modified"

I've also tried completely disabling the rewrite rules and this did not help either.

[arnab.roy]

Hi Guys,

I have the exact same problems. After the upgrade interestingly i noticed that on the top right hand corner with the green ticks we now have only 3 icons instead of 6. Can someone help ?

Many Thanks
Arnab

[slansing]

We are doing a bit more digging into this, we appreciate you guys letting us know about this. We will get back to you ASAP.

[nauessp]

I also only see three dots.

I wanted to note another symptom... when I do various things (like "schedule an immediate check" of a service) I get a little window back saying "Your request was not processed in a timely manner. It may still execute, as the server may be temporarily busy." Oddly, in the main window behind this wee notification I see the data actually update just fine.

Please let me know if you need any more logs, data, etc. Thanks so much!