Page 1 of 1

Connection timed out after 15001 milliseconds

Posted: Tue Apr 23, 2019 12:49 pm
by anilgupta
Team,

I am making change to nagios xi and clicking on "apply change".
This action is resulting in never ending Apply Configuration process.

Below is output of /usr/local/nagiosxi/var/cmdsubsys.log

Code: Select all

[nagios@cacbigdcapmdw51 scripts]$ tail -20 /usr/local/nagiosxi/var/cmdsubsys.log
PROCESSED 0 COMMANDS
...............Connection timed out after 15001 milliseconds
..............................................
PROCESSED 0 COMMANDS
...............Connection timed out after 15001 milliseconds
............................................
PROCESSED 0 COMMANDS
...............Connection timed out after 15001 milliseconds
.............................................
PROCESSED 0 COMMANDS
...............Connection timed out after 15001 milliseconds
.............................................
PROCESSED 0 COMMANDS
...............Connection timed out after 15001 milliseconds
..............................................
PROCESSED 0 COMMANDS
...............Connection timed out after 15001 milliseconds
............................................
PROCESSED 0 COMMANDS
Connection timed out after 15001 milliseconds
reconfigure_nagios also looks good to me.

Code: Select all

[nagios@cacbigdcapmdw51 scripts]$ ./reconfigure_nagios.sh

--- reset_config_perms.sh ------------
> Setting CCM script permissions
> Setting script permissions
> Setting special component script permissions
> Setting configuration file/directory permissions
> Setting perfdata directory and RRD permissions
> Setting Nagios XI config permissions
> Setting NOM checkpoint user:group permissions
> + Setting CCM configuration file user:group permissions
> + Setting Recurring Downtime file user:group permissions
> + Setting BPI configuration file user:group permissions
--------------------------------------

--- ccm_import.php -------------------
> Setting import directory: /usr/local/nagios/etc/import/
> Importing config files into the CCM
  No files to import
--------------------------------------

--- ccm_export.php -------------------
> Writing CCM configuration to Nagios files
  Finished writing out configuraton
--------------------------------------

--------------------------------------
> Verifying configuration with Nagios Core
> Output:
Nagios Core 4.4.3
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 2019-01-15
License: GPL

Website: https://www.nagios.org
Reading configuration data...
   Read main config file okay...
   Read object config files okay...

Running pre-flight check on configuration data...

Checking objects...
        Checked 25 services.
        Checked 4 hosts.
        Checked 4 host groups.
        Checked 0 service groups.
        Checked 2 contacts.
        Checked 5 contact groups.
        Checked 131 commands.
        Checked 8 time periods.
        Checked 0 host escalations.
        Checked 0 service escalations.
Checking for circular paths...
        Checked 4 hosts
        Checked 0 service dependencies
        Checked 0 host dependencies
        Checked 8 timeperiods
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...

Total Warnings: 0
Total Errors:   0

Things look okay - No serious problems were detected during the pre-flight check
> Return Code: 0
Please help.

Re: Connection timed out after 15001 milliseconds

Posted: Tue Apr 23, 2019 3:19 pm
by ssax
Do you have a proxy set in Admin > Proxy Configuration? If not, should you?

Please PM me a copy of your profile, you can download it from Admin > System Profile > Download Profile.

In addition, Please go to Configure > Core Config Manager > Tools > Config File Management:
- Click the Delete Files button (don't worry, it's safe, they will be rewritten)
- Then click the Write Configs button
- Once the configs are done being written, run this command (and leave it running):

Code: Select all

tail -F /usr/local/nagiosxi/var/cmdsubsys.log
Then try to apply configuration through the web interface again and once it completes/errors send me the full output from the tail command above.

Re: Connection timed out after 15001 milliseconds

Posted: Tue Apr 23, 2019 3:28 pm
by anilgupta
Please PM me a copy of your profile, you can download it from Admin > System Profile > Download Profile.
What is PM and how to do it?

Re: Connection timed out after 15001 milliseconds

Posted: Tue Apr 23, 2019 3:40 pm
by anilgupta
HI SSax,

disregard my last question. I understood it and sent you the profile as private message.

I followed your action plan for config file and tried to apply the changes. However, I don't get any message in /usr/local/nagiosxi/var/cmdsubsys.log, neither it is successful.

Code: Select all

[root@cacbigdcapmdw51 log]# tail -F /usr/local/nagiosxi/var/cmdsubsys.log
...............Connection timed out after 15001 milliseconds
.............................................
PROCESSED 0 COMMANDS
...............Connection timed out after 15001 milliseconds
..............................................
PROCESSED 0 COMMANDS
...............Connection timed out after 15001 milliseconds
............................................
PROCESSED 0 COMMANDS
Connection timed out after 15001 milliseconds

Re: Connection timed out after 15001 milliseconds

Posted: Tue Apr 23, 2019 4:40 pm
by npolovenko
@anilgupta, Are you using a proxy with this server or is there is a proxy on your network?

From the command line please run this command and show me the output:
curl -v 10.194.78.208
Backup your XI server and then remove the following files:
/usr/local/nagiosxi/scripts/nagiosql.login
/usr/local/nagiosxi/scripts/nagiosql.export.monitoring
/usr/local/nagiosxi/scripts/nagiosql.cookies
And then run the reconfigure_nagios script and show me the output:
/usr/local/nagiosxi/scripts/reconfigure_nagios.sh
Please zip and upload all the apache configs from this folder in the support ticket:
/etc/httpd/conf.d/
And upload the main httpd.conf file as well:
/etc/httpd/conf/httpd.conf

Re: Connection timed out after 15001 milliseconds

Posted: Wed Apr 24, 2019 8:16 am
by anilgupta
Are you using a proxy with this server or is there is a proxy on your network?
No, I am not using any proxy. Please note that this instance was working earlier and started showing this issue from yesterday.
From the command line please run this command and show me the output:
curl -v 10.194.78.208

Code: Select all

[guptaa@cacbigdcapmdw51 nagiosxi]$ curl -v 10.194.78.208
* About to connect() to 10.194.78.208 port 80 (#0)
*   Trying 10.194.78.208...
* Connected to 10.194.78.208 (10.194.78.208) port 80 (#0)
> GET / HTTP/1.1
> User-Agent: curl/7.29.0
> Host: 10.194.78.208
> Accept: */*
>
< HTTP/1.1 302 Found
< Date: Wed, 24 Apr 2019 12:38:20 GMT
< Server: Apache/2.4.6 (Red Hat Enterprise Linux) OpenSSL/1.0.2k-fips PHP/5.4.16
< Location: https://10.194.78.208/
< Content-Length: 206
< Content-Type: text/html; charset=iso-8859-1
<
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>302 Found</title>
</head><body>
<h1>Found</h1>
<p>The document has moved <a href="https://10.194.78.208/">here</a>.</p>
</body></html>
* Connection #0 to host 10.194.78.208 left intact
Backup your XI server and then remove the following files:
/usr/local/nagiosxi/scripts/nagiosql.login
/usr/local/nagiosxi/scripts/nagiosql.export.monitoring
/usr/local/nagiosxi/scripts/nagiosql.cookies
I do not find above files.

Code: Select all

[root@cacbigdcapmdw51 scripts]# pwd
/usr/local/nagiosxi/scripts
[root@cacbigdcapmdw51 scripts]# ls -ltr nagiosql.login
ls: cannot access nagiosql.login: No such file or directory
[root@cacbigdcapmdw51 scripts]# ls -ltr nagiosql.export.monitoring
ls: cannot access nagiosql.export.monitoring: No such file or directory
[root@cacbigdcapmdw51 scripts]# ls -ltr nagiosql.cookies
ls: cannot access nagiosql.cookies: No such file or directory
And then run the reconfigure_nagios script and show me the output:
/usr/local/nagiosxi/scripts/reconfigure_nagios.sh

Code: Select all

[root@cacbigdcapmdw51 scripts]# /usr/local/nagiosxi/scripts/reconfigure_nagios.sh

--- reset_config_perms.sh ------------
> Setting CCM script permissions
> Setting script permissions
> Setting special component script permissions
> Setting configuration file/directory permissions
> Setting perfdata directory and RRD permissions
> Setting Nagios XI config permissions
> Setting NOM checkpoint user:group permissions
> + Setting CCM configuration file user:group permissions
> + Setting Recurring Downtime file user:group permissions
> + Setting BPI configuration file user:group permissions
--------------------------------------

--- ccm_import.php -------------------
> Setting import directory: /usr/local/nagios/etc/import/
> Importing config files into the CCM
  No files to import
--------------------------------------

--- ccm_export.php -------------------
> Writing CCM configuration to Nagios files
  Finished writing out configuraton
--------------------------------------

--------------------------------------
> Verifying configuration with Nagios Core
> Output:
Nagios Core 4.4.3
Copyright (c) 2009-present Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 2019-01-15
License: GPL

Website: https://www.nagios.org
Reading configuration data...
   Read main config file okay...
   Read object config files okay...

Running pre-flight check on configuration data...

Checking objects...
        Checked 25 services.
        Checked 4 hosts.
        Checked 4 host groups.
        Checked 0 service groups.
        Checked 2 contacts.
        Checked 5 contact groups.
        Checked 131 commands.
        Checked 8 time periods.
        Checked 0 host escalations.
        Checked 0 service escalations.
Checking for circular paths...
        Checked 4 hosts
        Checked 0 service dependencies
        Checked 0 host dependencies
        Checked 8 timeperiods
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...

Total Warnings: 0
Total Errors:   0

Things look okay - No serious problems were detected during the pre-flight check
> Return Code: 0
--------------------------------------
Please zip and upload all the apache configs from this folder in the support ticket:
/etc/httpd/conf.d/
Uploaded conf.d.zip
And upload the main httpd.conf file as well:
/etc/httpd/conf/httpd.conf
Uploaded httpd.conf

Re: Connection timed out after 15001 milliseconds

Posted: Wed Apr 24, 2019 9:01 am
by ssax
Please create a ticket for this and include a link back to this forum thread so we can get a remote session setup:

https://support.nagios.com/tickets/

Re: Connection timed out after 15001 milliseconds

Posted: Wed Apr 24, 2019 9:32 am
by anilgupta
hello ssax,

Support Ticket Opened [#692950]

Re: Connection timed out after 15001 milliseconds

Posted: Wed Apr 24, 2019 11:56 am
by cdienger
We'll close the thread and continue working through the ticket.