Page 1 of 1

Nagios XI generating lots of files using high inodes

Posted: Mon May 28, 2018 2:38 am
by Endeavour Energy
Hi,

We have installed and configured Nagios XI on linux machine.

Issue is not able to login on nagios application not getting any issue.

We checke dan found that Nagios is generation lots of files. Directory /usr/local/nagios/var/spool/xidpe using high inodes.

[root@gdms01vp ~]# cd /usr/local/nagios/var/spool/xidpe/
[root@gdms01vp xidpe]# ls -l | wc -l
830497

Could you please suggest into this.

Thanks,
Rajeev Anand

Re: Nagios XI generating lots of files using high inodes

Posted: Tue May 29, 2018 8:31 am
by scottwilkerson
Make sure that cron service is running. It is normal for nagios to drop files there, but they should get picked up immediately and processed by the perfdataproc cron.

Re: Nagios XI generating lots of files using high inodes

Posted: Wed May 30, 2018 12:28 am
by Endeavour Energy
Hi,
Ran the below command to checked

service crond status

It is showing message crond (pid 2389) is working.

Shall i delete manually all the file generated in /usr/local/nagios/var/spool/xidpe

Please suggest

Re: Nagios XI generating lots of files using high inodes

Posted: Wed May 30, 2018 12:34 am
by Endeavour Energy
Hi,

On screen we are experiencing the below error.

SQL Error [ndoutils] : can't create/write to file /tmp/#sql_8fa_o.MYI

Thanks
Rajeev Anand

Re: Nagios XI generating lots of files using high inodes

Posted: Wed May 30, 2018 7:26 am
by scottwilkerson
is the disk full?

Code: Select all

df -h
If not what are the permissions on /tmp

Code: Select all

ls -ld /tmp

Re: Nagios XI generating lots of files using high inodes

Posted: Thu May 31, 2018 10:22 pm
by Endeavour Energy
Hi,

Ran the below command and checked

service crond status

It is showing message crond (pid 2389) is working.

Shall i delete manually all the file generated in /usr/local/nagios/var/spool/xidpe.

inode is 100% full.

Please suggest

Re: Nagios XI generating lots of files using high inodes

Posted: Fri Jun 01, 2018 6:52 am
by scottwilkerson
Endeavour Energy wrote:Shall i delete manually all the file generated in /usr/local/nagios/var/spool/xidpe.

inode is 100% full.
yes, but then you are going to want to see why this cron job isn't running.

Report the following

Code: Select all

chage -l nagios
tail -50 /var/log/cron
tail -50 /usr/local/nagiosxi/var/perfdataproc.log
Have you made any configuration mods lately like trying to install a ramdisk or anything like that?

Re: Nagios XI generating lots of files using high inodes

Posted: Mon Jun 04, 2018 9:01 pm
by Endeavour Energy
Hi

Result of below commands is attached as screenshot
chage -l nagios
tail -50 /var/log/cron
tail -50 /usr/local/nagiosxi/var/perfdataproc.log

Thanks
Rajeev

Re: Nagios XI generating lots of files using high inodes

Posted: Tue Jun 05, 2018 8:44 am
by scottwilkerson
Ok so there are several problems, first the password is expired for the Nagios user.

You should run the following

Code: Select all

chage -m 0 -M 99999 -I -1 -E -1 nagios
Second, you are out of disk space again but this should resolve once you fix the password ageing.