Page 1 of 1
The system hangs when click on Report
Posted: Wed Dec 23, 2020 4:27 am
by rragha2
Hi
Our system include around 20K Bandwidth service.
When we clicked on "Report" > "Bandwidth Usage", the system ran for a while and hang.
Please help to fix it.
Thanks,
Austin
Re: The system hangs when click on Report
Posted: Wed Dec 23, 2020 10:54 am
by ssax
Please PM me a copy of your profile, you can download it from Admin > System Profile by clicking the Download Profile button.
Please attach your
/etc/php.ini file as well.
Additionally, please send the output of these commands:
- NOTE: You may need to adjust the -h 127.0.0.1, the -uroot, and -pnagiosxi in the first command if your DB is offloaded to another server and/or you've changed the root mysql password
Code: Select all
echo "SELECT table_name AS 'Table', round(((data_length + index_length) / 1024 / 1024), 2) 'Size in MB' FROM information_schema.TABLES WHERE table_schema IN ('nagios', 'nagiosql', 'nagiosxi');" | mysql -h 127.0.0.1 -uroot -pnagiosxi --table
This next command may fail, that's okay, not all systems run postgresql, send the output anyways:
Code: Select all
echo "SELECT relname as Table, pg_size_pretty(pg_total_relation_size(relid)) As Size, pg_size_pretty(pg_total_relation_size(relid) - pg_relation_size(relid)) as ExternalSize FROM pg_catalog.pg_statio_user_tables ORDER BY pg_total_relation_size(relid) DESC;" | psql nagiosxi nagiosxi
Re: The system hangs when click on Report
Posted: Mon Dec 28, 2020 9:20 pm
by rragha2
Please refer the requested info in PM.
Re: The system hangs when click on Report
Posted: Tue Dec 29, 2020 10:13 am
by ssax
Please edit your
/usr/local/nagiosxi/html/config.inc.php and change this:
To this:
I'm also seeing this:
Code: Select all
[Wed Dec 23 17:27:33.540877 2020] [:error] [pid 20583] [client X.X.127.226:51779] PHP Fatal error: Maximum execution time of 600 seconds exceeded in /usr/local/nagiosxi/html/includes/components/bandwidthreport/index.php on line 1288, referer: https://X.X.127.233/nagiosxi/reports/
Given the size of your system, edit your
/etc/php.ini and change these:
Code: Select all
max_execution_time = 3600
max_input_vars=50000
Then restart apache:
Test the bandwidth report after that.
You are also hitting the load_threshold on your performance data which will stop graphs from being generated, please follow this KB article to increase your load_threshold to 60.0:
https://support.nagios.com/kb/article.php?id=9
Additionally, please send me the output of these commands:
Code: Select all
cat /etc/cron.d/mrtg
ls -lh /usr/local/nagios/var
You should also setup a RAMDisk as well:
https://assets.nagios.com/downloads/nag ... giosXI.pdf
Re: The system hangs when click on Report
Posted: Wed Dec 30, 2020 2:27 am
by rragha2
The system is still down after we changed the parameter you suggested and utilized the RAM disk.
Please find the output of commands you requested in the attachment.
Re: The system hangs when click on Report
Posted: Wed Dec 30, 2020 12:13 pm
by ssax
Please PM me a fresh copy of your profile, you can download it from Admin > System Profile by clicking the Download Profile button.
Please run these commands to fix an issue with your /usr/local/nagios/var/rw directory:
Code: Select all
chown -R nagios.nagcmd /usr/local/nagios/var/rw
chmod g+s /usr/local/nagios/var/rw
systemctl restart nagios
Re: The system hangs when click on Report
Posted: Sun Jan 03, 2021 9:26 pm
by rragha2
Please refer to Profile file in the attachment.
Moderator's Note: The profile has been shared with the support team but has been removed from the public forum.
Re: The system hangs when click on Report
Posted: Mon Jan 04, 2021 5:21 pm
by ssax
I'm not seeing anything stand out other than your system having roughly 50K checks and it's showing IO wait of 6.4% which usually means you have slow disks, overprovisioned storage, or a bottleneck between the VM host and the VM storage (if a VM). That means your XI system is waiting on storage 6+% of the time which will slow your system down dramatically. Considering the report you are using queries the filesystem logs to parse them that IO wait will have an impact on it.
Additionally, you still need to edit your
/usr/local/nagiosxi/html/config.inc.php and change this:
To this:
Please create a ticket for this and include a link back to this forum thread so we can get a remote session setup:
https://support.nagios.com/tickets/
Thank you!
Re: The system hangs when click on Report
Posted: Tue Jan 05, 2021 3:15 pm
by ssax
Locking thread, ticket received, we will continue support through the ticket.
Thank you!