Page 1 of 2
Reports page not working
Posted: Fri Feb 03, 2017 2:16 am
by nysus777
Hi team,
I am seeing a strange occurrence now in Nagios Xi, wherein our reports tab stops loading. Almost every time, the application hangs after this and none of the tabs work.
I see that CPU usage for the apache ( for avail.cgi) reaches 100% and hangs.
Please let me know how to resolve this, this has happened in between a customer demo unfortunately and we need to close this asap.
Thanks
Re: Reports page not working
Posted: Fri Feb 03, 2017 10:45 am
by rkennedy
How many hosts / services are in your system, and how large of a report were you trying to generate? It does take quite a bit of resources to generate a larger report, and can take time to generate reports depending on your environment since it is a single threaded process.
Can you post these files for us to review?
Code: Select all
/var/log/httpd/error_log
/var/log/httpd/ssl_error_log
/var/log/httpd/access_log
/var/log/httpd/ssl_access_log
Re: Reports page not working
Posted: Fri Feb 03, 2017 12:11 pm
by nysus777
Hi rkennedy,
Please find the logs attached as requested. the ssl_access_log is empty. We are not monitoring a lot of nodes, i.e. less than 50.
This was not happening earlier.
Thanks
Re: Reports page not working
Posted: Fri Feb 03, 2017 2:50 pm
by nysus777
Hi guys,
This is kindof urgent as this issue is holding up a demo for client, appreciate your prompt response.
Thanks.
Re: Reports page not working
Posted: Fri Feb 03, 2017 2:59 pm
by rkennedy
nysus777 wrote:Hi guys,
This is kindof urgent as this issue is holding up a demo for client, appreciate your prompt response.
Thanks.
Please do not bump threads, it will only put you back at the bottom of the queue.
Seeing a couple issues here -
Code: Select all
[Thu Feb 02 14:57:34.870298 2017] [:error] [pid 13027] [client 10.3.17.134:13169] PHP Warning: simplexml_load_string(): Entity: line 1: parser error : Start tag expected, '<' not found in /usr/local/nagiosxi/html/includes/utils-backend.inc.php on line 54, referer: http://10.3.28.150/nagiosxi/reports/
[Thu Feb 02 14:57:34.870325 2017] [:error] [pid 13027] [client 10.3.17.134:13169] PHP Warning: simplexml_load_string(): Message: A database connection error has been detected, we are attempting to rep in /usr/local/nagiosxi/html/includes/utils-backend.inc.php on line 54, referer: http://10.3.28.150/nagiosxi/reports/
[Thu Feb 02 14:57:34.870330 2017] [:error] [pid 13027] [client 10.3.17.134:13169] PHP Warning: simplexml_load_string(): ^ in /usr/local/nagiosxi/html/includes/utils-backend.inc.php on line 54, referer: http://10.3.28.150/nagiosxi/reports/
and
Code: Select all
[Sun Jan 29 03:18:01.991971 2017] [ssl:warn] [pid 2000] AH01909: RSA certificate configured for 127.0.0.1:443 does NOT include an ID which matches the server name
Both which could affect the problem at hand. Is your database crashed by any chance? You can repair it with
/usr/local/nagiosxi/scripts/repair_databases.sh - we may need to see a profile though which would show more about the system. Please download one, and PM it over to myself, and dwhitfield.
UPDATE: profile received and shared with techs
Re: Reports page not working
Posted: Fri Feb 03, 2017 11:07 pm
by nysus777
Hi rkennedy,
I have pinged you and dwhitfield the details. Kindly check and get back.
Thanks.
Re: Reports page not working
Posted: Sun Feb 05, 2017 12:25 am
by nysus777
Hi team,
Do we have anything on this?
Re: Reports page not working
Posted: Mon Feb 06, 2017 10:18 am
by rkennedy
nysus777 wrote:Hi team,
Do we have anything on this?
Again, please do not bump threads as mentioned above.
rkennedy wrote:nysus777 wrote:Hi guys,
This is kindof urgent as this issue is holding up a demo for client, appreciate your prompt response.
Thanks.
Please do not bump threads, it will only put you back at the bottom of the queue.
It looks like you still have 500 services on the machine - how large of a report were you trying to run? It will take time to generate.
Noticed this in your profile -
Code: Select all
Connecting to localhost (localhost)|::1|:80... failed: Connection refused.
Can you please post your /etc/hosts file? We may need to remove the IPv6 resolver, as this could impact the reporting.
Re: Reports page not working
Posted: Tue Feb 07, 2017 1:55 am
by nysus777
Hi rkennedy,
It looks like you still have 500 services on the machine - how large of a report were you trying to run? It will take time to generate.
I do not understand what do you mean by this. The application was hung, none of the tabs were working and one of the processes were at 100 % cpu utilization continously.
I am PMing you the /etc/hosts file.
Thanks.
Re: Reports page not working
Posted: Tue Feb 07, 2017 10:44 am
by rkennedy
nysus777 wrote:Hi rkennedy,
It looks like you still have 500 services on the machine - how large of a report were you trying to run? It will take time to generate.
I do not understand what do you mean by this. The application was hung, none of the tabs were working and one of the processes were at 100 % cpu utilization continously.
I am PMing you the /etc/hosts file.
Thanks.
I understand this - how large of a report were you running? Since it's single threaded, running a large report can cause this.