Reports page not working

[nysus777]

Hi team,

I am seeing a strange occurrence now in Nagios Xi, wherein our reports tab stops loading. Almost every time, the application hangs after this and none of the tabs work.

I see that CPU usage for the apache ( for avail.cgi) reaches 100% and hangs.

Please let me know how to resolve this, this has happened in between a customer demo unfortunately and we need to close this asap.

Thanks

[rkennedy]

How many hosts / services are in your system, and how large of a report were you trying to generate? It does take quite a bit of resources to generate a larger report, and can take time to generate reports depending on your environment since it is a single threaded process.

Can you post these files for us to review?

Code: Select all

/var/log/httpd/error_log
/var/log/httpd/ssl_error_log
/var/log/httpd/access_log
/var/log/httpd/ssl_access_log

[nysus777]

Hi rkennedy,

Please find the logs attached as requested. the ssl_access_log is empty. We are not monitoring a lot of nodes, i.e. less than 50.

This was not happening earlier.

Thanks

[nysus777]

Hi guys,

This is kindof urgent as this issue is holding up a demo for client, appreciate your prompt response.

Thanks.

[rkennedy]

Hi guys,

This is kindof urgent as this issue is holding up a demo for client, appreciate your prompt response.

Thanks.

Please do not bump threads, it will only put you back at the bottom of the queue.

Seeing a couple issues here -

Code: Select all

[Thu Feb 02 14:57:34.870298 2017] [:error] [pid 13027] [client 10.3.17.134:13169] PHP Warning:  simplexml_load_string(): Entity: line 1: parser error : Start tag expected, '<' not found in /usr/local/nagiosxi/html/includes/utils-backend.inc.php on line 54, referer: http://10.3.28.150/nagiosxi/reports/
[Thu Feb 02 14:57:34.870325 2017] [:error] [pid 13027] [client 10.3.17.134:13169] PHP Warning:  simplexml_load_string(): Message: A database connection error has been detected, we are attempting to rep in /usr/local/nagiosxi/html/includes/utils-backend.inc.php on line 54, referer: http://10.3.28.150/nagiosxi/reports/
[Thu Feb 02 14:57:34.870330 2017] [:error] [pid 13027] [client 10.3.17.134:13169] PHP Warning:  simplexml_load_string(): ^ in /usr/local/nagiosxi/html/includes/utils-backend.inc.php on line 54, referer: http://10.3.28.150/nagiosxi/reports/

and

Code: Select all

[Sun Jan 29 03:18:01.991971 2017] [ssl:warn] [pid 2000] AH01909: RSA certificate configured for 127.0.0.1:443 does NOT include an ID which matches the server name

Both which could affect the problem at hand. Is your database crashed by any chance? You can repair it with /usr/local/nagiosxi/scripts/repair_databases.sh - we may need to see a profile though which would show more about the system. Please download one, and PM it over to myself, and dwhitfield.

UPDATE: profile received and shared with techs

[nysus777]

Hi rkennedy,

I have pinged you and dwhitfield the details. Kindly check and get back.

Thanks.

[nysus777]

Hi team,

Do we have anything on this?

[rkennedy]

Hi team,

Do we have anything on this?

Again, please do not bump threads as mentioned above.

Hi guys,

This is kindof urgent as this issue is holding up a demo for client, appreciate your prompt response.

Thanks.

Please do not bump threads, it will only put you back at the bottom of the queue.

It looks like you still have 500 services on the machine - how large of a report were you trying to run? It will take time to generate.

Noticed this in your profile -

Code: Select all

Connecting to localhost (localhost)|::1|:80... failed: Connection refused.

Can you please post your /etc/hosts file? We may need to remove the IPv6 resolver, as this could impact the reporting.

[nysus777]

Hi rkennedy,

It looks like you still have 500 services on the machine - how large of a report were you trying to run? It will take time to generate.

I do not understand what do you mean by this. The application was hung, none of the tabs were working and one of the processes were at 100 % cpu utilization continously.

I am PMing you the /etc/hosts file.

Thanks.

[rkennedy]

Hi rkennedy,

It looks like you still have 500 services on the machine - how large of a report were you trying to run? It will take time to generate.

I do not understand what do you mean by this. The application was hung, none of the tabs were working and one of the processes were at 100 % cpu utilization continously.

I am PMing you the /etc/hosts file.

Thanks.

I understand this - how large of a report were you running? Since it's single threaded, running a large report can cause this.