'Apply Configuration' fails, restore of ok configs also fail

[atuttle]

On both of our Nagios XI installations 'Apply Configuration' fails.
Restoring any snapshot also fails.
Nagios XI has been running fine for almost 2 years.
This is on Nagios XI Version : 2014R2.7, Red Hat Enterprise Linux Server release 6.6 2.6.32-279.5.2.el6.x86_64 x86_64.
Gnome is not installed
PHP Version: 5.3.3.
Nagios XI Data
License ends in: NSRRQO

nagios (pid 8101) is running...
NPCD running (pid 20614).
ndo2db (pid 12962) is running...
CPU Load 15: 1.13
Total Hosts: 98
Total Services: 528
Function 'get_backend_url(internal_call=true)' returns: https://localhost/nagiosxi/backend/

[tmcdonald]

Please run the following command as root from the Nagios server command line and post the results:

Code: Select all

cd /usr/local/nagiosxi/scripts
./reconfigure_nagios.sh | tail -20

[atuttle]

--2015-05-28 11:30:09-- https://localhost/nagiosxi/includes/components/ccm/
Resolving localhost... 127.0.0.1
Connecting to localhost|127.0.0.1|:443... connected.
WARNING: cannot verify localhost’s certificate, issued by “/C=US/ST=Washington/L=Seattle/O=UWMC-ITS/OU=DCOM-Ops/CN=its-nagios-p1/emailAddress=[email protected]”:
Self-signed certificate encountered.
WARNING: certificate common name “its-nagios-p1” doesn't match requested host name “localhost”.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: “nagiosql.login”

[ <=> ] 10,422 --.-K/s in 0.01s

2015-05-28 11:30:09 (688 KB/s) - “nagiosql.login” saved [10422]

--2015-05-28 11:30:09-- https://localhost/nagiosxi/includes/components/ccm/
Resolving localhost... 127.0.0.1
Connecting to localhost|127.0.0.1|:443... connected.
WARNING: cannot verify localhost’s certificate, issued by “/C=US/ST=Washington/L=Seattle/O=UWMC-ITS/OU=DCOM-Ops/CN=its-nagios-p1/emailAddress=[email protected]”:
Self-signed certificate encountered.
WARNING: certificate common name “its-nagios-p1” doesn't match requested host name “localhost”.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: “nagiosql.login”

[ <=> ] 10,422 --.-K/s in 0.01s

2015-05-28 11:30:10 (686 KB/s) - “nagiosql.login” saved [10422]

--2015-05-28 11:30:10-- https://localhost/nagiosxi/includes/components/ccm/
Resolving localhost... 127.0.0.1
Connecting to localhost|127.0.0.1|:443... connected.
WARNING: cannot verify localhost’s certificate, issued by “/C=US/ST=Washington/L=Seattle/O=UWMC-ITS/OU=DCOM-Ops/CN=its-nagios-p1/emailAddress=[email protected]”:
Self-signed certificate encountered.
WARNING: certificate common name “its-nagios-p1” doesn't match requested host name “localhost”.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: “nagiosql.export.monitoring”

[ <=> ] 13,415 24.8K/s in 0.5s

2015-05-28 11:30:11 (24.8 KB/s) - “nagiosql.export.monitoring” saved [13415]

Checked 20 time periods.
Checked 0 host escalations.
Checked 0 service escalations.
Checking for circular paths...
Checked 99 hosts
Checked 0 service dependencies
Checked 0 host dependencies
Checked 20 timeperiods
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...

Total Warnings: 0
Total Errors: 0

Things look okay - No serious problems were detected during the pre-flight check
RET: 0
Running configuration check...
Stopping nagios:.. done.
Starting nagios: done.

[tgriep]

Could you run the following in a shell on the server, Click Apply Configuration and post the output back?

Code: Select all

fail -f /usr/local/nagiosxi/var/cmdsubsys.log

[atuttle]

fail: command not found

[abrist]

fail -f /usr/local/nagiosxi/var/cmdsubsys.log

fail: command not found

LOL.
Try:
Running the following in a shell on the server, Click Apply Configuration and post the output back:

Code: Select all

tail -f /usr/local/nagiosxi/var/cmdsubsys.log

[atuttle]

Last change I made was yesterday when I updated component "Nagios Incident Manager" from 1.5.0 to version 2.2.0 .
I just learned I can no longer use the Admin screen to stop or restart the Monitoring Engine, Performance Grapher, and Performance Grapher.

[atuttle]

..................................
PROCESSED 0 COMMANDS
AND: CMD=17, DATA=
APPLYING NAGIOSCORE CONFIG...
CMDLINE=cd /usr/local/nagiosxi/scripts && ./reconfigure_nagios.sh
xURL: https://localhost/nagiosxi/includes/components/ccm/
CMDLINE
--2015-05-28 12:25:42-- https://localhost/nagiosxi/includes/components/ccm/
Resolving localhost... 127.0.0.1
Connecting to localhost|127.0.0.1|:443... connected.
WARNING: cannot verify localhost’s certificate, issued by “/C=US/ST=Washington.edu”:
Self-signed certificate encountered.
WARNING: certificate common name “its-nagios-p1” doesn't match requested host name “localhost”.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: “nagiosql.login”

0K .......... 674K=0.02s

2015-05-28 12:25:42 (674 KB/s) - “nagiosql.login” saved [10422]

/usr/bin/wget --save-cookies nagiosql.cookies --keep-session-cookies https://localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'submit=Login&hidelog=true&loginSubmitted=true&username=nagiosxi&password=84r' -O nagiosql.loginLOGIN SUCCESSFUL!
IMPORTING CONFIG FILES...xURL: https://localhost/nagiosxi/includes/components/ccm/
Array
(
)
RESETTING PERMS
SETUID ROOT OK
localhost/nagiosxi/includes/components/ccm/
CMDLINE
--2015-05-28 12:25:42-- https://localhost/nagiosxi/includes/components/ccm/
Resolving localhost... 127.0.0.1
Connecting to localhost|127.0.0.1|:443... connected.
WARNING: cannot verify localhost’s certificate, issued by “/C=US/ST=Washington/L.edu”:
Self-signed certificate encountered.
WARNING: certificate common name “its-nagios-p1” doesn't match requested host name “localhost”.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: “nagiosql.login”

0K .......... 707K=0.01s

2015-05-28 12:25:43 (707 KB/s) - “nagiosql.login” saved [10422]

/usr/bin/wget --save-cookies nagiosql.cookies --keep-session-cookies https://localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'submit=Login&hidelog=true&loginSubmitted=true&username=nagiosxi&password=84rdbq' -O nagiosql.loginLOGIN SUCCESSFUL!
localhost/nagiosxi/includes/components/ccm/
CMDLINE:
/usr/bin/wget --load-cookies=nagiosql.cookies https://localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'cmd=apply&type=writeConfig' -O nagiosql.export.monitoring
--2015-05-28 12:25:43-- https://localhost/nagiosxi/includes/components/ccm/
Resolving localhost... 127.0.0.1
Connecting to localhost|127.0.0.1|:443... connected.
WARNING: cannot verify localhost’s certificate, issued by “/C=US/ST=Washington/L=Seattle/OUW.edu”:
Self-signed certificate encountered.
WARNING: certificate common name “its-nagios-p1” doesn't match requested host name “localhost”.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: “nagiosql.export.monitoring”

0K .......... .. 24.7K=0.5s

2015-05-28 12:25:43 (24.7 KB/s) - “nagiosql.export.monitoring” saved [13278]

WRITE CONFIGS SUCCESSFUL!
OUTPUT:
Nagios Core 4.0.8
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 08-12-2014
License: GPL

Website: http://www.nagios.org
Reading configuration data...
Read main config file okay...
Read object config files okay...

Running pre-flight check on configuration data...

Checking objects...
Checked 539 services.
Checked 99 hosts.
Checked 17 host groups.
Checked 6 service groups.
Checked 15 contacts.
Checked 3 contact groups.
Checked 130 commands.
Checked 20 time periods.
Checked 0 host escalations.
Checked 0 service escalations.
Checking for circular paths...
Checked 99 hosts
Checked 0 service dependencies
Checked 0 host dependencies
Checked 20 timeperiods
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...

Total Warnings: 0
Total Errors: 0

Things look okay - No serious problems were detected during the pre-flight check
RET: 0
sudo: no tty present and no askpass program specified
OUTPUT=RET: 0
RETURNCODE=6
.................
PROCESSED 1 COMMANDS
tail: /usr/local/nagiosxi/var/cmdsubsys.log: file truncated

[atuttle]

My sudoers has these entries:
nagios ALL=NOPASSWD:/sbin/hpasmcli
nagios ALL=NOPASSWD:/usr/bin/cciss_vol_status
nagios ALL=NOPASSWD:/opt/nagios/libexec/
nagios ALL=NOPASSWD:/usr/local/nrpe/libexec/

[ssax]

Please PM me your /etc/sudoers file.

Also, if you have an /etc/sudoers.d/nagiosxi file let us know.