Page 1 of 3
Nagios XI reorts are not coming or very very slow
Posted: Thu Dec 26, 2019 1:00 pm
by biswajit.banerjee
Hi
Nagios XI ( 5.6.1 )are either very very slow or not coming
php.ini recommendation already done
Some inputs are
Mysql is offloaded on AWS RDS
in /usr/local/nagios/var/archive/ has 2017 and 2018 directory with archive logs
Httpd error log contains "[Thu Dec 26 09:27:27.004881 2019] [:error] [pid 30684] [client 10.144.0.180:14292] PHP Notice: Undefined variable: class in /usr/local/nagiosxi/html/includes/components/nocscreen/nocscreenapi.php on line 425, referer:
http://nagiosxi.vvv.com/nagiosxi/includ ... en/noc.php
Please suggest how we can resolve this .
TIA
Re: Nagios XI reorts are not coming or very very slow
Posted: Thu Dec 26, 2019 4:30 pm
by ssax
Please run through these KB articles for troubleshooting:
https://support.nagios.com/kb/article/n ... s-829.html
https://support.nagios.com/kb/article/n ... g-742.html
Additionally, please run this tail command as root (and leave it running):
Code: Select all
tail -Fn0 /var/log/httpd/error_log /var/log/httpd/ssl_error_log /usr/local/nagiosxi/var/cmdsubsys.log /usr/local/nagiosxi/var/eventman.log /usr/local/nagiosxi/var/scheduledreporting.log
Then force the report to be sent and send me the full output of the tail command once it's completed.
Please PM a copy of your profile as well, you can download it from
Admin > System Profile > Download Profile.
Re: Nagios XI reorts are not coming or very very slow
Posted: Fri Dec 27, 2019 6:49 am
by biswajit.banerjee
Hi
I have PM you both the details .
Thanks
Re: Nagios XI reorts are not coming or very very slow
Posted: Fri Dec 27, 2019 11:40 am
by ssax
First, upgrade to the latest XI as I believe you are hitting a bug that was fixed in the latest version:
https://assets.nagios.com/downloads/nag ... ctions.pdf
I see a lot of these:
[Fri, 27 Dec 2019 04:29:14 -0500] DEBUG: [12-27-2019 04:29:07] SMTP connect() failed.
https://github.com/PHPMailer/PHPMailer/ ... leshooting (method=smtp;host=XXXXXX.XXXXX.XXXX;port=587;smtpauth=true;security=tls), Referer: includes/components/scheduledreporting > Scheduled Report
Enabled debugging:
https://support.nagios.com/kb/article/p ... g-820.html
Then test email functionality from
Admin > Email Settings and send me the entire output from the screen when it fails.
Then do this:
You also have this issue that needs to be resolved:
You have some old components that need to be removed (migrated to) which can impact performance (and could also cause something like this).
You will need to do this:
First, set nagiosadmin to a local account (if it isn't already, in Admin > Manage Users) and logout/log back into the system with it.
Then, disable active directory authentication in
Admin > Manage Components > Active Directory > Settings, double check
Admin > Manage Components > LDAP Auth > Settings is disabled as well.
Then setup the new component (copying the info from the old) in
Admin > LDAP / AD Integration.
-- See below if you have questions
https://assets.nagios.com/downloads/nag ... ios-XI.pdf
See here as well if you have issues:
https://support.nagios.com/kb/article/a ... n-600.html
Once you've done that and tested login functionality you can run these commands to get rid of the slowness:
Code: Select all
rm -rf /usr/local/nagiosxi/html/includes/components/active_directory
rm -rf /usr/local/nagiosxi/html/includes/components/ldapauth
Once you've upgraded AND done all steps above:
Logout of XI, close the browser, log back into XI, and test the email functionality again.
Re: Nagios XI reorts are not coming or very very slow
Posted: Fri Dec 27, 2019 1:48 pm
by biswajit.banerjee
My Issue is not the scheduled report and we are not using it at this moment . My issue is online generation of Report .
What I understood from your solution is that the mail issue will be resolved . I have checked on manage Components found that Active Directory component does not require update and is upto date .
As this is prod and cannot have down time on this nagios xi . Kindly suggest any other way to diagnose .
Thanks
Re: Nagios XI reorts are not coming or very very slow
Posted: Fri Dec 27, 2019 3:43 pm
by ssax
Ok, thank you for clearing that up, my mistake.
Just to be clear though, there is related bug with AD/LDAP that was fixed in the most recent release and since I saw those messages in your Scheduled Reporting log file which is why I recommend you upgrade.
Is it only the Availability and SLA reports OR some other specific report OR all reports?
If it is the Availability report, does it run fast if you run it from the Nagios Core interface?
http://YOURXISERVER/nagios/
We have an Availability/SLA report performance fix but it won't be released until XI 5.7. I have a process that you can upgrade the backend Nagios Core to a custom version and replace 3 additional files that should speed up the availability and SLA reports but it's a manual process at this point. Would you be able to try that or do you need to wait for an official release?
If so, please attach attach your
/etc/php.ini.
Re: Nagios XI reorts are not coming or very very slow
Posted: Sat Dec 28, 2019 11:04 am
by biswajit.banerjee
Hi , Thanks for the Update . Please find the details required by you as below
Is it only the Availability and SLA reports OR some other specific report OR all reports?
A: Mainly Availability, SLA and Executive Reports
If it is the Availability report, does it run fast if you run it from the Nagios Core interface?
A: Yes Legacy report of Availability is comparatively fast .
Please let me know the Manual Fix .
php.ini is attached .
php.ini
Thanks
Regards
Re: Nagios XI reorts are not coming or very very slow
Posted: Mon Dec 30, 2019 4:39 pm
by tgriep
The messages in the log for a component that talks to an discontinued product called Nagios Instant Message server and if you are not using it, you can remove it.
It can be removed from the system by running the following.
Code: Select all
mv /usr/local/nagiosxi/html/includes/components/nagiosim /root
That speed up the system as it will not have to run that script and generate an error all of the time.
How long does the report take using the Legacy report?
How long does the report take using the XI report?
Re: Nagios XI reorts are not coming or very very slow
Posted: Tue Dec 31, 2019 8:47 am
by biswajit.banerjee
Hi
To Answer Your Questions
Q:How long does the report take using the Legacy report?
A: Probably more than a hour , I have waited for 30+ Minutes but report never got generated .
Q:How long does the report take using the XI report?
A: within a minute .
Have Moved the Nagiosim component , but did not help .
@ssax was supposed to suggest some manual method . Can it be shared ?
Thanks
Re: Nagios XI reorts are not coming or very very slow
Posted: Thu Jan 02, 2020 12:38 pm
by tgriep
FYI, the following are the instructions to upgrade your system with applications and scripts that have not been rigorously tested.
Make a full backup of the Nagios XI server beforehand so you can go back if needed.
First you need to upgrade Nagios core to an development version with the speed enhancements. Run the following as root.
Code: Select all
cd /tmp
https://github.com/NagiosEnterprises/nagioscore/archive/cgi-avail-filtering.zip
unzip cgi-avail-filtering.zip
cd nagioscore-cgi-avail-filtering
./configure --with-command-group=nagcmd
make nagios cgis
make install
Next, you need to upgrade some PHP scripts for Nagios XI.
The 3 php scripts are attached to this post in a zip file.
Extract the PHP files and over write the copies on the Nagios XI server in the following locations.
Code: Select all
/usr/local/nagiosxi/html/reports/sla.php
/usr/local/nagiosxi/html/reports/availability.php
/usr/local/nagiosxi/html/includes/utils-reports.inc.php
Run the following as root to restart the processes.
Code: Select all
service nagios restart
service httpd restart
Wait a few minutes for the processes to run and then run the reports and see if it helps.