NagiosXI 5.3.1 - Waiting for configuration verification
Posted: Tue Oct 25, 2016 6:42 am
hi! yesterday i have clean all hosts and services with ccm in our NagiosXI 5.3.1. Today we can't apply new configurations, ccm when apply config still saying "Waiting for configuration verification .. . "
If we go to Admin/System Status, we have Monitoring,Performance and Database Backend green but al other components in red. If launch restart for Monitoring Engine he show the error after 30 seconds "Your request was not processed in a timely manner. It may still execute, as the server may be temporarily busy".
We have check:
disk space
check permisions
logs files from /var/log/httpd, /usr/local/nagiosxi/var
ps & top for CPU use
mysql access and select (this mysql is remote)
i have restarted the server and the problem persists
this is our NagiosXI System Profile
Nagios XI Installation Profile
System:
Nagios XI Version : 5.3.1
mo6nap02 3.10.0-327.36.2.el7.x86_64 x86_64
CentOS Linux release 7.2.1511 (Core)
Gnome is not installed
Apache Information
PHP Version: 5.4.16
Agent: Mozilla/5.0 (X11; Fedora; Linux x86_64; rv:49.0) Gecko/20100101 Firefox/49.0
Server Name: nagiosxi.it.service
Server Address: 10.162.237.174
Server Port: 80
Date/Time
PHP Timezone: Europe/Madrid
PHP Time: Tue, 25 Oct 2016 13:37:45 +0200
System Time: Tue, 25 Oct 2016 13:37:45 +0200
Nagios XI Data
License ends in: VSPQVQ
nagios (pid 15784) is running...
NPCD running (pid 14152).
ndo2db (pid 14190) is running...
CPU Load 15: 0.05
Total Hosts: 6
Total Services: 60
Function 'get_base_uri' returns: nagiosxi.it.service/nagiosxi/
Function 'get_base_url' returns: nagiosxi.it.service/nagiosxi/
Function 'get_backend_url(internal_call=false)' returns: nagiosxi.it.service/nagiosxi/includes/components/profile/profile.php
Function 'get_backend_url(internal_call=true)' returns: localhost/nagiosxi/backend/
Ping Test localhost
Running:
/bin/ping -c 3 localhost 2>&1
PING localhost (127.0.0.1) 56(84) bytes of data.
64 bytes from localhost (127.0.0.1): icmp_seq=1 ttl=64 time=0.024 ms
64 bytes from localhost (127.0.0.1): icmp_seq=2 ttl=64 time=0.036 ms
64 bytes from localhost (127.0.0.1): icmp_seq=3 ttl=64 time=0.039 ms
--- localhost ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 1999ms
rtt min/avg/max/mdev = 0.024/0.033/0.039/0.006 ms
Test wget To localhost
WGET From URL: http://localhost/nagiosxi/includes/components/ccm/
Running:
/usr/bin/wget http://localhost/nagiosxi/includes/components/ccm/
--2016-10-25 13:37:47-- http://localhost/nagiosxi/includes/components/ccm/
Resolving localhost (localhost)... 127.0.0.1, ::1
Connecting to localhost (localhost)|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: '/usr/local/nagiosxi/tmp/ccm_index.tmp'
0K .......... ........ 1.53M=0.01s
2016-10-25 13:37:47 (1.53 MB/s) - '/usr/local/nagiosxi/tmp/ccm_index.tmp' saved [18900]
Network Settings
1: lo: mtu 65536 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
2: ens160: mtu 1500 qdisc mq state UP qlen 1000
link/ether 00:50:56:95:12:18 brd ff:ff:ff:ff:ff:ff
inet 10.162.250.15/23 brd 10.162.251.255 scope global ens160
valid_lft forever preferred_lft forever
3: ens192: mtu 1500 qdisc mq state UP qlen 1000
link/ether 00:50:56:95:08:a7 brd ff:ff:ff:ff:ff:ff
4: ens224: mtu 1500 qdisc mq state UP qlen 1000
link/ether 00:50:56:95:3c:97 brd ff:ff:ff:ff:ff:ff
inet 10.162.237.174/23 brd 10.162.237.255 scope global ens224
valid_lft forever preferred_lft forever
5: ens256: mtu 1500 qdisc mq state UP qlen 1000
link/ether 00:50:56:95:58:21 brd ff:ff:ff:ff:ff:ff
inet 172.21.250.25/22 brd 172.21.251.255 scope global ens256
valid_lft forever preferred_lft forever
default via 10.162.236.3 dev ens224 proto static metric 100
10.162.236.0/23 dev ens224 proto kernel scope link src 10.162.237.174 metric 100
10.162.250.0/23 dev ens160 proto kernel scope link src 10.162.250.15 metric 100
172.21.248.0/22 dev ens256 proto kernel scope link src 172.21.250.25 metric 100
172.22.141.0/24 via 10.162.250.3 dev ens160 proto static metric 100
we have launched reconfigure_nagios.. this is the output
[root@mo6nap02 scripts]# ./reconfigure_nagios.sh
URL: http://localhost/nagiosxi/includes/components/ccm/
CMDLINE
/usr/bin/wget --save-cookies nagiosql.cookies --keep-session-cookies localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'submit=Login&hidelog=true&loginSubmitted=true&username=nagiosxi&password=n@gweb' -O nagiosql.login--2016-10-25 13:40:28-- localhost/nagiosxi/includes/components/ccm/
Resolving localhost (localhost)... 127.0.0.1, ::1
Connecting to localhost (localhost)|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘nagiosql.login’
[ <=> ] 38,925 --.-K/s in 0.01s
2016-10-25 13:40:28 (3.40 MB/s) - ‘nagiosql.login’ saved [38925]
LOGIN SUCCESSFUL!
IMPORTING CONFIG FILES...URL: http://localhost/nagiosxi/includes/components/ccm/
Array
(
)
RESETTING PERMS
URL: http://localhost/nagiosxi/includes/components/ccm/
CMDLINE
/usr/bin/wget --save-cookies nagiosql.cookies --keep-session-cookies localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'submit=Login&hidelog=true&loginSubmitted=true&username=nagiosxi&password=n@gweb' -O nagiosql.login--2016-10-25 13:40:29-- localhost/nagiosxi/includes/components/ccm/
Resolving localhost (localhost)... 127.0.0.1, ::1
Connecting to localhost (localhost)|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘nagiosql.login’
[ <=> ] 38,925 --.-K/s in 0.01s
2016-10-25 13:40:29 (3.05 MB/s) - ‘nagiosql.login’ saved [38925]
LOGIN SUCCESSFUL!
URL: http://localhost/nagiosxi/includes/components/ccm/
CMDLINE:
/usr/bin/wget --load-cookies=nagiosql.cookies localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'cmd=apply&type=writeConfig' -O nagiosql.export.monitoring
--2016-10-25 13:40:29-- localhost/nagiosxi/includes/components/ccm/
Resolving localhost (localhost)... 127.0.0.1, ::1
Connecting to localhost (localhost)|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘nagiosql.export.monitoring’
[ <=> ] 21,537 --.-K/s in 0.01s
2016-10-25 13:40:30 (1.70 MB/s) - ‘nagiosql.export.monitoring’ saved [21537]
WRITE CONFIGS SUCCESSFUL!
OUTPUT:
Nagios Core 4.1.1
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 08-19-2015
License: GPL
Website: https://www.nagios.org
Reading configuration data...
Read main config file okay...
Read object config files okay...
Running pre-flight check on configuration data...
Checking objects...
Checked 60 services.
Checked 6 hosts.
Checked 4 host groups.
Checked 3 service groups.
Checked 40 contacts.
Checked 4 contact groups.
Checked 147 commands.
Checked 44 time periods.
Checked 0 host escalations.
Checked 0 service escalations.
Checking for circular paths...
Checked 6 hosts
Checked 0 service dependencies
Checked 0 host dependencies
Checked 44 timeperiods
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...
Total Warnings: 0
Total Errors: 0
Things look okay - No serious problems were detected during the pre-flight check
RET: 0
[root@mo6nap02 scripts]#
If we go to Admin/System Status, we have Monitoring,Performance and Database Backend green but al other components in red. If launch restart for Monitoring Engine he show the error after 30 seconds "Your request was not processed in a timely manner. It may still execute, as the server may be temporarily busy".
We have check:
disk space
check permisions
logs files from /var/log/httpd, /usr/local/nagiosxi/var
ps & top for CPU use
mysql access and select (this mysql is remote)
i have restarted the server and the problem persists
this is our NagiosXI System Profile
Nagios XI Installation Profile
System:
Nagios XI Version : 5.3.1
mo6nap02 3.10.0-327.36.2.el7.x86_64 x86_64
CentOS Linux release 7.2.1511 (Core)
Gnome is not installed
Apache Information
PHP Version: 5.4.16
Agent: Mozilla/5.0 (X11; Fedora; Linux x86_64; rv:49.0) Gecko/20100101 Firefox/49.0
Server Name: nagiosxi.it.service
Server Address: 10.162.237.174
Server Port: 80
Date/Time
PHP Timezone: Europe/Madrid
PHP Time: Tue, 25 Oct 2016 13:37:45 +0200
System Time: Tue, 25 Oct 2016 13:37:45 +0200
Nagios XI Data
License ends in: VSPQVQ
nagios (pid 15784) is running...
NPCD running (pid 14152).
ndo2db (pid 14190) is running...
CPU Load 15: 0.05
Total Hosts: 6
Total Services: 60
Function 'get_base_uri' returns: nagiosxi.it.service/nagiosxi/
Function 'get_base_url' returns: nagiosxi.it.service/nagiosxi/
Function 'get_backend_url(internal_call=false)' returns: nagiosxi.it.service/nagiosxi/includes/components/profile/profile.php
Function 'get_backend_url(internal_call=true)' returns: localhost/nagiosxi/backend/
Ping Test localhost
Running:
/bin/ping -c 3 localhost 2>&1
PING localhost (127.0.0.1) 56(84) bytes of data.
64 bytes from localhost (127.0.0.1): icmp_seq=1 ttl=64 time=0.024 ms
64 bytes from localhost (127.0.0.1): icmp_seq=2 ttl=64 time=0.036 ms
64 bytes from localhost (127.0.0.1): icmp_seq=3 ttl=64 time=0.039 ms
--- localhost ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 1999ms
rtt min/avg/max/mdev = 0.024/0.033/0.039/0.006 ms
Test wget To localhost
WGET From URL: http://localhost/nagiosxi/includes/components/ccm/
Running:
/usr/bin/wget http://localhost/nagiosxi/includes/components/ccm/
--2016-10-25 13:37:47-- http://localhost/nagiosxi/includes/components/ccm/
Resolving localhost (localhost)... 127.0.0.1, ::1
Connecting to localhost (localhost)|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: '/usr/local/nagiosxi/tmp/ccm_index.tmp'
0K .......... ........ 1.53M=0.01s
2016-10-25 13:37:47 (1.53 MB/s) - '/usr/local/nagiosxi/tmp/ccm_index.tmp' saved [18900]
Network Settings
1: lo: mtu 65536 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
2: ens160: mtu 1500 qdisc mq state UP qlen 1000
link/ether 00:50:56:95:12:18 brd ff:ff:ff:ff:ff:ff
inet 10.162.250.15/23 brd 10.162.251.255 scope global ens160
valid_lft forever preferred_lft forever
3: ens192: mtu 1500 qdisc mq state UP qlen 1000
link/ether 00:50:56:95:08:a7 brd ff:ff:ff:ff:ff:ff
4: ens224: mtu 1500 qdisc mq state UP qlen 1000
link/ether 00:50:56:95:3c:97 brd ff:ff:ff:ff:ff:ff
inet 10.162.237.174/23 brd 10.162.237.255 scope global ens224
valid_lft forever preferred_lft forever
5: ens256: mtu 1500 qdisc mq state UP qlen 1000
link/ether 00:50:56:95:58:21 brd ff:ff:ff:ff:ff:ff
inet 172.21.250.25/22 brd 172.21.251.255 scope global ens256
valid_lft forever preferred_lft forever
default via 10.162.236.3 dev ens224 proto static metric 100
10.162.236.0/23 dev ens224 proto kernel scope link src 10.162.237.174 metric 100
10.162.250.0/23 dev ens160 proto kernel scope link src 10.162.250.15 metric 100
172.21.248.0/22 dev ens256 proto kernel scope link src 172.21.250.25 metric 100
172.22.141.0/24 via 10.162.250.3 dev ens160 proto static metric 100
we have launched reconfigure_nagios.. this is the output
[root@mo6nap02 scripts]# ./reconfigure_nagios.sh
URL: http://localhost/nagiosxi/includes/components/ccm/
CMDLINE
/usr/bin/wget --save-cookies nagiosql.cookies --keep-session-cookies localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'submit=Login&hidelog=true&loginSubmitted=true&username=nagiosxi&password=n@gweb' -O nagiosql.login--2016-10-25 13:40:28-- localhost/nagiosxi/includes/components/ccm/
Resolving localhost (localhost)... 127.0.0.1, ::1
Connecting to localhost (localhost)|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘nagiosql.login’
[ <=> ] 38,925 --.-K/s in 0.01s
2016-10-25 13:40:28 (3.40 MB/s) - ‘nagiosql.login’ saved [38925]
LOGIN SUCCESSFUL!
IMPORTING CONFIG FILES...URL: http://localhost/nagiosxi/includes/components/ccm/
Array
(
)
RESETTING PERMS
URL: http://localhost/nagiosxi/includes/components/ccm/
CMDLINE
/usr/bin/wget --save-cookies nagiosql.cookies --keep-session-cookies localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'submit=Login&hidelog=true&loginSubmitted=true&username=nagiosxi&password=n@gweb' -O nagiosql.login--2016-10-25 13:40:29-- localhost/nagiosxi/includes/components/ccm/
Resolving localhost (localhost)... 127.0.0.1, ::1
Connecting to localhost (localhost)|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘nagiosql.login’
[ <=> ] 38,925 --.-K/s in 0.01s
2016-10-25 13:40:29 (3.05 MB/s) - ‘nagiosql.login’ saved [38925]
LOGIN SUCCESSFUL!
URL: http://localhost/nagiosxi/includes/components/ccm/
CMDLINE:
/usr/bin/wget --load-cookies=nagiosql.cookies localhost/nagiosxi/includes/components/ccm/ --no-check-certificate --post-data 'cmd=apply&type=writeConfig' -O nagiosql.export.monitoring
--2016-10-25 13:40:29-- localhost/nagiosxi/includes/components/ccm/
Resolving localhost (localhost)... 127.0.0.1, ::1
Connecting to localhost (localhost)|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘nagiosql.export.monitoring’
[ <=> ] 21,537 --.-K/s in 0.01s
2016-10-25 13:40:30 (1.70 MB/s) - ‘nagiosql.export.monitoring’ saved [21537]
WRITE CONFIGS SUCCESSFUL!
OUTPUT:
Nagios Core 4.1.1
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 08-19-2015
License: GPL
Website: https://www.nagios.org
Reading configuration data...
Read main config file okay...
Read object config files okay...
Running pre-flight check on configuration data...
Checking objects...
Checked 60 services.
Checked 6 hosts.
Checked 4 host groups.
Checked 3 service groups.
Checked 40 contacts.
Checked 4 contact groups.
Checked 147 commands.
Checked 44 time periods.
Checked 0 host escalations.
Checked 0 service escalations.
Checking for circular paths...
Checked 6 hosts
Checked 0 service dependencies
Checked 0 host dependencies
Checked 44 timeperiods
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...
Total Warnings: 0
Total Errors: 0
Things look okay - No serious problems were detected during the pre-flight check
RET: 0
[root@mo6nap02 scripts]#