Stuck at "Waiting for configuration verification"

[Pres-Gas]

Hello,

I have a fresh install of Nagios XI 2014R2.7 and was attempting to implement the RAM disk according to the docs:

http://assets.nagios.com/downloads/nagi ... giosXI.pdf

I am at the point where I need to edit the core commands to use the disk:

command_name process-host-perfdata-file-bulk
command_line /bin/mv /var/nagiosramdisk/host-perfdata /var/nagiosramdisk/spool/xidpe/$TIMET$.perfdata.host
command_name process-service-perfdata-file-bulk
command_line /bin/mv /var/nagiosramdisk/service-perfdata /var/nagiosramdisk/spool/xidpe/$TIMET$.perfdata.service

and am stuck at the verification part.

I made the ram disk permanent and all is coming up the way it seems to except for that change and it is still pending.

I made the changes from the FAQ in php.ini with Resource Limits and this has not worked:
http://support.nagios.com/wiki/index.ph ... _Completes

I have searched the forums and noted that the hits I got of hanging in verification were for older versions, but this is a fresh install of 2014R2.7.

Tell me what you would like me to provide as additional information.

Robert

[jolson]

Is this a manual build or a VM template? If it's manual, what OS did you perform the initial install on?

Code: Select all

cat /etc/*release*

Ensure that your RAM disk is mounted properly:

Code: Select all

mount

Ensure that permissions on your RAM disk are proper:

Code: Select all

ls -l -d /var/nagiosramdisk 

I just want to note that you should be sure to type the commands from the PDF out, as copy+pasting from PDFs can cause problems.

If you run a nagios restart from the CLI as the 'nagios' user, do you get any errors?

Code: Select all

su - nagios
cd /usr/local/nagiosxi/scripts
./reconfigure_nagios.sh

[Pres-Gas]

jolson,

I should have given you the additional details, apologies. Yes it is a manual install with default settings. It looks like the ramdisk is operating as advertised as per below.

[root@esnagxitst01 httpd]# cat /etc/*release*
LSB_VERSION=base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch:graphics-4.0-amd64:graphics-4.0-noarch:printing-4.0-amd64:printing-4.0-noarch
cat: /etc/lsb-release.d: Is a directory
Red Hat Enterprise Linux Server release 6.6 (Santiago)
Red Hat Enterprise Linux Server release 6.6 (Santiago)
cpe:/o:redhat:enterprise_linux:6server:ga:server

[root@esnagxitst01 httpd]# mount
/dev/mapper/VolGroupDR-LogVolRoot on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/sda1 on /boot type ext4 (rw)
/dev/mapper/VolGroupDR-LogVolHome on /home type ext4 (rw)
/dev/mapper/VolGroupDR-LogVolOpt on /opt type ext4 (rw)
/dev/mapper/VolGroupDR-LogVolTmp on /tmp type ext4 (rw)
/dev/mapper/VolGroupDR-LogVolUsr on /usr type ext4 (rw)
/dev/mapper/VolGroupDR-LogVolVar on /var type ext4 (rw)
/dev/mapper/VolGrpNagiosXI-LogVolUsrLocal on /usr/local type ext4 (rw)
/dev/mapper/VolGrpNagiosXI-LogVolVarLib on /var/lib type ext4 (rw)
tmpfs on /var/nagiosramdisk type tmpfs (rw,size=50m)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)

[root@esnagxitst01 httpd]# ls -ld /var/nagiosramdisk
drwxrwxrwt 4 nagios nagios 160 May 12 16:15 /var/nagiosramdisk

[root@esnagxitst01 httpd]# ls -l /var/nagiosramdisk
total 880
-rw-r--r-- 1 nagios nagios 82269 May 12 16:20 host-perfdata
-rw-r--r-- 1 nagios nagios 28566 May 11 15:37 objects.cache
-rw-r--r-- 1 nagios nagios 766635 May 12 16:23 service-perfdata
drwxrwxr-x 5 nagios nagios 100 May 11 15:37 spool
-rw-r--r-- 1 nagios nagios 13883 May 12 16:23 status.dat
drwxrwxr-x 2 nagios nagios 40 May 12 13:36 tmp

But here is an interesting bit with the reconfigure_nagios.sh script:

[root@esnagxitst01 httpd]# su - nagios
-bash-4.1$ cd /usr/local/nagiosxi/scripts/
-bash-4.1$ ./reconfigure_nagios.sh
URL: http://localhost/nagiosxi/includes/components/ccm/
CMDLINE
/usr/bin/wget --save-cookies nagiosql.cookies --keep-session-cookies http://localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'submit=Login&hidelog=true&loginSubmitted=true&username=nagiosxi&password=n@gweb' -O nagiosql.login--2015-05-12 16:16:14-- http://localhost/nagiosxi/includes/components/ccm/
Resolving localhost... 127.0.0.1
Connecting to localhost|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://localhost/nagiosxi/includes/components/ccm/ [following]
--2015-05-12 16:16:14-- https://localhost/nagiosxi/includes/components/ccm/
Connecting to localhost|127.0.0.1|:443... connected.
WARNING: no certificate subject alternative name matches
requested host name “localhost”.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: “nagiosql.login”

[ <=> ] 8,882 --.-K/s in 0.006s

2015-05-12 16:16:14 (1.33 MB/s) - “nagiosql.login” saved [8882]

NAGIOSQL LOGIN FAILED!
-bash-4.1$

I am redirecting everything to 443 on /etc/httpd/conf/httpd.conf:

RewriteEngine On
RewriteCond %{HTTPS} off
RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI}

However, it still looks like it is getting the post statement properly with the --no-check-certificate option.

I did not specify any change in passowrd and accepted the defaults on install.

Thanks,
Robert

[jolson]

Let's take a look at your scripts folder to ensure the proper nagiosql files were generated:

Code: Select all

ls -l /usr/local/nagiosxi/scripts | grep nagiosql

You should see nagiosql.cookies and nagiosql.login. Ensure that both files are owned by nagios:nagios and try another reconfigure if you changed permissions.
We'll also want to ensure that selinux is disabled:

Code: Select all

sestatus

[Pres-Gas]

All looks as it should be from what I see:

[root@esnagxitst01 httpd]# ls -l /usr/local/nagiosxi/scripts | grep nagiosql
-rwxr-xr-x 1 nagios nagios 652 May 8 09:35 export_nagiosql.sh
-rwxr-xr-x 1 nagios nagios 432 May 8 09:35 import_nagiosql.sh
-rwxrwxr-x 1 nagios nagios 161 May 12 16:16 nagiosql.cookies
-rwxrwxr-x 1 nagios nagios 271780 May 8 09:35 nagiosql_defaults.sql
-rwxrwxr-x 1 nagios nagios 952 May 8 09:35 nagiosql_delete_contact.php
-rwxrwxr-x 1 nagios nagios 1991 May 8 09:35 nagiosql_delete_host.php
-rwxrwxr-x 1 nagios nagios 509 May 8 09:35 nagiosql_delete_object.sh
-rwxrwxr-x 1 nagios nagios 2846 May 8 09:35 nagiosql_delete_service.php
-rwxrwxr-x 1 nagios nagios 955 May 8 09:35 nagiosql_delete_timeperiod.php
-rwxrwxr-x 1 nagios nagios 1334 May 8 09:35 nagiosql_exportall.php
-rwxrwxr-x 1 nagios nagios 1333 May 8 09:35 nagiosql_importall.php
-rwxrwxr-x 1 nagios nagios 8882 May 12 16:16 nagiosql.login
-rwxrwxr-x 1 nagios nagios 1849 May 8 09:35 nagiosql_login.php
-rwxrwxr-x 1 nagios nagios 2246 May 8 09:35 nagiosql_snapshot.sh
-rwxrwxr-x 1 nagios nagios 262 May 8 09:35 nagiosql_trim_backups.sh

[root@esnagxitst01 httpd]# sestatus
SELinux status: disabled

[jolson]

Could you disable your HTTP redirection and retry the reconfigure_nagios procedure? This way we'll know whether or not the redirect is impacting the problem.

If not, I recommend trying to move the nagiosql files to someplace else and re-run the restore script:

Code: Select all

su - nagios
cd /usr/local/nagiosxi/scripts
mv nagiosql.cookies /tmp/
mv nagiosql.login /tmp/
./reconfigure_nagios.sh

Are the files generated the same as the files you have just moved?

Code: Select all

diff /tmp/nagiosql.cookies /usr/local/nagiosxi/scripts/nagiosql.cookies
diff /tmp/nagiosql.login /usr/local/nagiosxi/scripts/nagiosql.login

[Pres-Gas]

Okay, I was able to try it without ssl and am now getting a 403 error on the POST:

Code: Select all

bash-4.1$ ./reconfigure_nagios.sh 
URL: http://localhost/nagiosxi/includes/components/ccm/
CMDLINE
/usr/bin/wget --save-cookies nagiosql.cookies --keep-session-cookies http://localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'submit=Login&hidelog=true&loginSubmitted=true&username=nagiosxi&password=n@gweb' -O nagiosql.login--2015-05-13 09:43:59--  http://localhost/nagiosxi/includes/components/ccm/
Resolving localhost... 127.0.0.1
Connecting to localhost|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 403 Forbidden
2015-05-13 09:43:59 ERROR 403: Forbidden.

NAGIOSQL LOGIN FAILED!

I then did the move of the nagiosql files:

Code: Select all

-bash-4.1$ mv nagiosql.
nagiosql.cookies  nagiosql.login    
-bash-4.1$ mv nagiosql.* /tmp/
-bash-4.1$ ./reconfigure_nagios.sh 
URL: http://localhost/nagiosxi/includes/components/ccm/
CMDLINE
/usr/bin/wget --save-cookies nagiosql.cookies --keep-session-cookies http://localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'submit=Login&hidelog=true&loginSubmitted=true&username=nagiosxi&password=n@gweb' -O nagiosql.login--2015-05-13 09:46:59--  http://localhost/nagiosxi/includes/components/ccm/
Resolving localhost... 127.0.0.1
Connecting to localhost|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 403 Forbidden
2015-05-13 09:46:59 ERROR 403: Forbidden.

NAGIOSQL LOGIN FAILED!

Diffing the files show no changes:

Code: Select all

-bash-4.1$ diff /tmp/nagiosql.cookies /usr/local/nagiosxi/scripts/nagiosql.cookies
2c2
< # Generated by Wget on 2015-05-13 09:43:59.
---
> # Generated by Wget on 2015-05-13 09:46:59.
-bash-4.1$ diff /tmp/nagiosql.login /usr/local/nagiosxi/scripts/nagiosql.login

I should note that the initial install did fail at install.php and it recommended that I run "/usr/local/nagiosxi/scripts/repair_databases.sh" and all seemed well at that time. I am not sure if that had anything to do with it, but thought I would put it out there.

Thanks,
Robert

[lmiltchev]

I should note that the initial install did fail at install.php and it recommended that I run "/usr/local/nagiosxi/scripts/repair_databases.sh" and all seemed well at that time. I am not sure if that had anything to do with it, but thought I would put it out there.

Is there any chance for you to try to reinstall or at least run the "upgrade" script to see if this is going to fix the issue? "403 forbidden" looks like an apache/security related issue, or a proxy. Are you using a proxy? If you are, have you excluded localhost?

http://support.nagios.com/wiki/index.ph ... th_Proxies

[Pres-Gas]

We are not using a proxy, but the IP space is restricted from routing out (internal network, routable to org subnets but not to the outside world).

I have no proxy configured in httpd, but do have a rewrite to force ssl, excluding localhost:

Code: Select all

#Move everything to https
RewriteEngine On
RewriteCond %{HTTP_HOST} !=localhost
RewriteCond %{HTTPS} off
RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI}

I did completely comment it out, restarted httpd and am getting the following in /var/log/httpd/error_log :

[Wed May 13 11:17:21 2015] [error] [client 127.0.0.1] access to /usr/local/nagiosxi/html/backend/ failed, reason: SSL connection required
[Wed May 13 11:17:22 2015] [error] [client 127.0.0.1] access to /usr/local/nagiosxi/html/backend/ failed, reason: SSL connection required
[Wed May 13 11:17:23 2015] [error] [client 127.0.0.1] access to /usr/local/nagiosxi/html/backend/ failed, reason: SSL connection required
[Wed May 13 11:17:24 2015] [error] [client 127.0.0.1] access to /usr/local/nagiosxi/html/backend/ failed, reason: SSL connection required

[Pres-Gas]

Okay, I forgot to also comment out SSLRequireSSL in /etc/httpd/conf.d/nagiosxi.conf

I would really like most connections to be over ssl to follow our org's security policy, or at least the login. Suggested docs to achieve that without breaking?

I will also look on my own.

Thanks,
Robert