Page 1 of 2
Root File system getting full NagiosXI
Posted: Wed Jan 19, 2022 12:24 pm
by mejokj
Hi Team,
We are facing an issue with Nagiosxi.
The root disk is getting full every time and not able to login because of that.
We have 45GB of / filesystem with 80 hosts and 176 services. Initially, we have only 35GB / space, which got full and increased to 45GB. Now the 45GB also got full.
While looking into the folder, the MySQL folder getting full always.
Logs using very low space.
Can you suggest why the / filesystem is getting full very frequently? Is it because of any issue with the database (done database repair script, doesn't find any issue) because size of MySQL folder increasing every time we increase / filesystem.
Re: Root File system getting full NagiosXI
Posted: Thu Jan 20, 2022 12:58 pm
by gsmith
Hi
1. Take a look at /usr/local/nagios/etc/nagios.cfg and let me know the value for the setting:
log_rotation_method=
2. Which mysql directory are you referring too? For example I have:
./var/lib/mysql
./var/lib/mysql/mysql
./usr/lib/python2.7/site-packages/ansible/modules/database/mysql
./usr/lib64/perl5/vendor_perl/auto/DBD/mysql
./usr/lib64/perl5/vendor_perl/DBD/mysql
./usr/lib64/mysql
./usr/share/mysql
./usr/include/mysql
./store/backups/mysql
./store/backups/mysql/daily/mysql
./store/backups/mysql/weekly/mysql
3. Please run this command and let me know the output:
awk '/"nagiosxi" => array\(/{getline;print}' /usr/local/nagiosxi/html/config.inc.php
Thanks
Re: Root File system getting full NagiosXI
Posted: Mon Feb 14, 2022 9:45 am
by mejokj
Hi gsmith,
Shared the screenshots as a PM with you.
Please have a look.
Thanks
Re: Root File system getting full NagiosXI
Posted: Mon Feb 14, 2022 10:04 am
by mejokj
Attached some more screenshots
Re: Root File system getting full NagiosXI
Posted: Mon Feb 14, 2022 10:24 am
by mejokj
Database is repaired successfully.
Want to understand the disk getting full due to /var/lib/mysql folder size increasing. Due to / file system database tables getting crashing and nagios getting down
1. Take a look at /usr/local/nagios/etc/nagios.cfg and let me know the value for the setting:
log_rotation_method=
================================
log_rotation_method=d
Re: Root File system getting full NagiosXI
Posted: Mon Feb 14, 2022 6:02 pm
by gsmith
Hi
Could you please run:
find / -path ./proc -prune -o -path ./sys -prune -o -iname *.ibd
and post the output?
Thanks!
Re: Root File system getting full NagiosXI
Posted: Tue Feb 15, 2022 2:08 am
by mejokj
Send you as PM.
Re: Root File system getting full NagiosXI
Posted: Tue Feb 15, 2022 2:29 pm
by gsmith
Hi,
So I think the #sql*.ibd files are from mysql crashes. For now please leave them there while I investigate.
Please run:
ls -l /var/lib/mysql/nagio* >> /tmp/dbfiles.txt
And send me the resulting /tmp/dbfiles.txt file.
Thanks!
Re: Root File system getting full NagiosXI
Posted: Thu Feb 17, 2022 10:49 am
by mejokj
PM the details requested
Re: Root File system getting full NagiosXI
Posted: Fri Feb 18, 2022 1:34 am
by mejokj
Any update?