Nagios XI reorts are not coming or very very slow

[biswajit.banerjee]

Hi
Nagios XI ( 5.6.1 )are either very very slow or not coming
php.ini recommendation already done
Some inputs are
Mysql is offloaded on AWS RDS
in /usr/local/nagios/var/archive/ has 2017 and 2018 directory with archive logs
Httpd error log contains "[Thu Dec 26 09:27:27.004881 2019] [:error] [pid 30684] [client 10.144.0.180:14292] PHP Notice: Undefined variable: class in /usr/local/nagiosxi/html/includes/components/nocscreen/nocscreenapi.php on line 425, referer: http://nagiosxi.vvv.com/nagiosxi/includ ... en/noc.php

Please suggest how we can resolve this .

TIA

[ssax]

Please run through these KB articles for troubleshooting:

https://support.nagios.com/kb/article/n ... s-829.html

https://support.nagios.com/kb/article/n ... g-742.html

Additionally, please run this tail command as root (and leave it running):

Code: Select all

tail -Fn0 /var/log/httpd/error_log /var/log/httpd/ssl_error_log /usr/local/nagiosxi/var/cmdsubsys.log /usr/local/nagiosxi/var/eventman.log /usr/local/nagiosxi/var/scheduledreporting.log

Then force the report to be sent and send me the full output of the tail command once it's completed.

Please PM a copy of your profile as well, you can download it from Admin > System Profile > Download Profile.

[biswajit.banerjee]

Hi

I have PM you both the details .

Thanks

[ssax]

First, upgrade to the latest XI as I believe you are hitting a bug that was fixed in the latest version:

https://assets.nagios.com/downloads/nag ... ctions.pdf

I see a lot of these:

[Fri, 27 Dec 2019 04:29:14 -0500] DEBUG: [12-27-2019 04:29:07] SMTP connect() failed. https://github.com/PHPMailer/PHPMailer/ ... leshooting (method=smtp;host=XXXXXX.XXXXX.XXXX;port=587;smtpauth=true;security=tls), Referer: includes/components/scheduledreporting > Scheduled Report

Enabled debugging:

https://support.nagios.com/kb/article/p ... g-820.html

Then test email functionality from Admin > Email Settings and send me the entire output from the screen when it fails.


Then do this:

You also have this issue that needs to be resolved:

You have some old components that need to be removed (migrated to) which can impact performance (and could also cause something like this).

You will need to do this:

First, set nagiosadmin to a local account (if it isn't already, in Admin > Manage Users) and logout/log back into the system with it.

Then, disable active directory authentication in Admin > Manage Components > Active Directory > Settings, double check Admin > Manage Components > LDAP Auth > Settings is disabled as well.

Then setup the new component (copying the info from the old) in Admin > LDAP / AD Integration.
-- See below if you have questions

https://assets.nagios.com/downloads/nag ... ios-XI.pdf

See here as well if you have issues:

https://support.nagios.com/kb/article/a ... n-600.html

Once you've done that and tested login functionality you can run these commands to get rid of the slowness:

Code: Select all

rm -rf /usr/local/nagiosxi/html/includes/components/active_directory
rm -rf /usr/local/nagiosxi/html/includes/components/ldapauth

Once you've upgraded AND done all steps above:

Logout of XI, close the browser, log back into XI, and test the email functionality again.

[biswajit.banerjee]

My Issue is not the scheduled report and we are not using it at this moment . My issue is online generation of Report .
What I understood from your solution is that the mail issue will be resolved . I have checked on manage Components found that Active Directory component does not require update and is upto date .
As this is prod and cannot have down time on this nagios xi . Kindly suggest any other way to diagnose .
Thanks

[ssax]

Ok, thank you for clearing that up, my mistake.

Just to be clear though, there is related bug with AD/LDAP that was fixed in the most recent release and since I saw those messages in your Scheduled Reporting log file which is why I recommend you upgrade.

Is it only the Availability and SLA reports OR some other specific report OR all reports?

If it is the Availability report, does it run fast if you run it from the Nagios Core interface?

http://YOURXISERVER/nagios/

We have an Availability/SLA report performance fix but it won't be released until XI 5.7. I have a process that you can upgrade the backend Nagios Core to a custom version and replace 3 additional files that should speed up the availability and SLA reports but it's a manual process at this point. Would you be able to try that or do you need to wait for an official release?

If so, please attach attach your /etc/php.ini.

[biswajit.banerjee]

Hi , Thanks for the Update . Please find the details required by you as below

Is it only the Availability and SLA reports OR some other specific report OR all reports?
A: Mainly Availability, SLA and Executive Reports

If it is the Availability report, does it run fast if you run it from the Nagios Core interface?
A: Yes Legacy report of Availability is comparatively fast .

Please let me know the Manual Fix .

php.ini is attached .

php.ini

Thanks
Regards

[tgriep]

The messages in the log for a component that talks to an discontinued product called Nagios Instant Message server and if you are not using it, you can remove it.

It can be removed from the system by running the following.

Code: Select all

mv /usr/local/nagiosxi/html/includes/components/nagiosim /root

That speed up the system as it will not have to run that script and generate an error all of the time.


How long does the report take using the Legacy report?
How long does the report take using the XI report?

[biswajit.banerjee]

Hi
To Answer Your Questions
Q:How long does the report take using the Legacy report?
A: Probably more than a hour , I have waited for 30+ Minutes but report never got generated .

Q:How long does the report take using the XI report?
A: within a minute .

Have Moved the Nagiosim component , but did not help .

@ssax was supposed to suggest some manual method . Can it be shared ?

Thanks

[tgriep]

FYI, the following are the instructions to upgrade your system with applications and scripts that have not been rigorously tested.
Make a full backup of the Nagios XI server beforehand so you can go back if needed.

First you need to upgrade Nagios core to an development version with the speed enhancements. Run the following as root.

Code: Select all

cd /tmp
https://github.com/NagiosEnterprises/nagioscore/archive/cgi-avail-filtering.zip
unzip cgi-avail-filtering.zip
cd nagioscore-cgi-avail-filtering
./configure --with-command-group=nagcmd
make nagios cgis
make install

Next, you need to upgrade some PHP scripts for Nagios XI.
The 3 php scripts are attached to this post in a zip file.
Extract the PHP files and over write the copies on the Nagios XI server in the following locations.

Code: Select all

/usr/local/nagiosxi/html/reports/sla.php
/usr/local/nagiosxi/html/reports/availability.php
/usr/local/nagiosxi/html/includes/utils-reports.inc.php

Run the following as root to restart the processes.

Code: Select all

service nagios restart
service httpd restart

Wait a few minutes for the processes to run and then run the reports and see if it helps.