Page 1 of 2

Tremendous delay when generating reports

Posted: Mon Jul 27, 2020 9:59 am
by coitop
Hello,

As stated in the title, whenever we try to generate a report (say SLA), it takes about 20 minutes to bring it up. We have around 850 devices and 8000 checks. Is there a configuration setting for allocating more memory or is there something else we need to change?
Application Server (We have DB in a different server):
CPU > 6 cores
RAM > 16Gb

[root@xxxx tmp]# free -m
total used free shared buff/cache available
Mem: 15866 1311 4687 848 9868 13200
Swap: 4095 33 4062

One last question, how do we contact someone and use our phone or additional tickets support?

Thanks

Re: Tremendous delay when generating reports

Posted: Mon Jul 27, 2020 3:16 pm
by benjaminsmith
Hi,

We've made performance improvements to the SLA reports recently, what version of Nagios XI are you currently using?

This report is very I/O intensive but 20 minutes is high. What time period are you running the report on? Also, I would go ahead and optimize the PHP settings to allow for more memory for the GUI.

Nagios XI - Optimizing The PHP Settings File

Also, can you run the report and then download a system profile so I can review the logs? Thanks, Benjamin

To send us your system profile.
Login to the Nagios XI GUI using a web browser.
Click the "Admin" > "System Profile" Menu
Click the "Download Profile" button
Save the profile.zip file and share in a private message or upload it to the post/ticket, and then reply to this post to bring it up in the queue.

If you have phone support on your account, just call your general number 1-651-204-9102. The support team is extension 4. Our support hours are as follows ( Central Time). Let me know if you have any questions.

Monday – Thursday: 9:00 am – 5:00 pm
Friday: 9:00 am – 2:00 pm

Re: Tremendous delay when generating reports

Posted: Tue Jul 28, 2020 1:58 am
by coitop
benjaminsmith wrote:Hi,

We've made performance improvements to the SLA reports recently, what version of Nagios XI are you currently using?

This report is very I/O intensive but 20 minutes is high. What time period are you running the report on? Also, I would go ahead and optimize the PHP settings to allow for more memory for the GUI.

Nagios XI - Optimizing The PHP Settings File

Also, can you run the report and then download a system profile so I can review the logs? Thanks, Benjamin

To send us your system profile.
Login to the Nagios XI GUI using a web browser.
Click the "Admin" > "System Profile" Menu
Click the "Download Profile" button
Save the profile.zip file and share in a private message or upload it to the post/ticket, and then reply to this post to bring it up in the queue.

If you have phone support on your account, just call your general number 1-651-204-9102. The support team is extension 4. Our support hours are as follows ( Central Time). Let me know if you have any questions.

Monday – Thursday: 9:00 am – 5:00 pm
Friday: 9:00 am – 2:00 pm
Hello Benjamin,

I have pmed you the profile.log, it was created after trying to get the availability summary report that starts when press "Reports" (needed around 10 mins for this, 24h period).
Our version is 5.6.14 and php settings we already had are below:
memory_limit = 2048M
max_execution_time = 120
max_input_time = 150

Thank you

Re: Tremendous delay when generating reports

Posted: Tue Jul 28, 2020 1:40 pm
by benjaminsmith
Hi,

I just sent a reply to your PM regarding the system profile. Also, with respect to the PHP settings, make sure to increase the max_input_vars, for example:

Code: Select all

max_input_vars = 50000

Re: Tremendous delay when generating reports

Posted: Thu Jul 30, 2020 1:05 am
by coitop
benjaminsmith wrote:Hi,

I just sent a reply to your PM regarding the system profile. Also, with respect to the PHP settings, make sure to increase the max_input_vars, for example:

Code: Select all

max_input_vars = 50000
Already have this as well Benjamin

; How many GET/POST/COOKIE input variables may be accepted
max_input_vars = 50000

Re: Tremendous delay when generating reports

Posted: Thu Jul 30, 2020 1:35 pm
by benjaminsmith
Hi @coitop,

Can your try to PM your profile once more? Thanks!

Re: Tremendous delay when generating reports

Posted: Fri Jul 31, 2020 4:39 am
by coitop
I am trying to send you the profile but the message is stack in outbox folder as you can see in the picture attached. Does the folder contain anything vital or I can upload it here as well?

Re: Tremendous delay when generating reports

Posted: Fri Jul 31, 2020 5:26 pm
by benjaminsmith
Hi,

Looking over the profile I noticed a few things. One is the message queues, please go ahead a follow the steps in the following kb article to increase the system's settings:

NDOUtils - Message Queue Exceeded

Next, got to Admin > System Config > System Setting, and make sure the program URL settings are correct. If you're using the FQDN, try setting the ip address instead.

Code: Select all

 httpd: Could not reliably determine the server's fully qualified domain name, using x.x.x.60. Set the 'ServerName' directive globally to suppress this message
Are you using any type of proxy server in your environment? Also, it's connecting internally over a non-standard port and it's not the same address as the server.

Code: Select all

Connecting to x.x.x.58:8080... connected.
Proxy tunneling failed: Proxy Error ( Connection refused )Unable to establish SSL connection.
Lastly, it looks like the database is offloaded, can you fetch the databse log from the remote server and post it to the thread. Thanks, Benjamin

Re: Tremendous delay when generating reports

Posted: Mon Aug 03, 2020 4:17 am
by coitop
benjaminsmith wrote:Hi,

Looking over the profile I noticed a few things. One is the message queues, please go ahead a follow the steps in the following kb article to increase the system's settings:

NDOUtils - Message Queue Exceeded

Next, got to Admin > System Config > System Setting, and make sure the program URL settings are correct. If you're using the FQDN, try setting the ip address instead.

Code: Select all

 httpd: Could not reliably determine the server's fully qualified domain name, using x.x.x.60. Set the 'ServerName' directive globally to suppress this message
Are you using any type of proxy server in your environment? Also, it's connecting internally over a non-standard port and it's not the same address as the server.

Code: Select all

Connecting to x.x.x.58:8080... connected.
Proxy tunneling failed: Proxy Error ( Connection refused )Unable to establish SSL connection.
Lastly, it looks like the database is offloaded, can you fetch the databse log from the remote server and post it to the thread. Thanks, Benjamin
Hello Benjamin,

I made the "NDOUtils - Message Queue Exceeded" changes and fixed the URL settings to HTTPS and IP. I have not changed anything regarding proxy, but I doubt this affects the reporting, correct?

Can you please tell me which exact logs you need from the DB? Where can I find them, because the only log I see from the DB has only the started - ended lines.

Thank you

Re: Tremendous delay when generating reports

Posted: Mon Aug 03, 2020 3:17 pm
by benjaminsmith
Hi,

I'd like to get the whole database log file if possible, depending on the system it should be one following files for RHEL/Cent OS:

Code: Select all

/var/log/mariadb/mariadb.log
/var/log/mysqld.log
If you change the default port from 80 to 8080, you'll need to update the following 3 areas:

Code: Select all

File - /etc/httpd/conf/httpd.conf
Look for Listen 80 change to Listen 8080
File - /usr/local/nagiosxi/html/config.inc.php

Code: Select all

Look for $cfg['port_number'] = 80; change to $cfg['port_number'] = 8081;
Admin > System Config > Manage System Config
- Change Program URL and External URL (if you have it set) to include the port.

Going through a proxy can cause issues with Nagios XI, especially upgrades. Some info on this and suggestions in the following kb article.
Nagios XI - Problems Using Nagios XI With Proxies