Nagios XI generating lots of files using high inodes

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
Locked
Endeavour Energy
Posts: 5
Joined: Thu Feb 15, 2018 9:42 pm

Nagios XI generating lots of files using high inodes

Post by Endeavour Energy »

Hi,

We have installed and configured Nagios XI on linux machine.

Issue is not able to login on nagios application not getting any issue.

We checke dan found that Nagios is generation lots of files. Directory /usr/local/nagios/var/spool/xidpe using high inodes.

[root@gdms01vp ~]# cd /usr/local/nagios/var/spool/xidpe/
[root@gdms01vp xidpe]# ls -l | wc -l
830497

Could you please suggest into this.

Thanks,
Rajeev Anand
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Nagios XI generating lots of files using high inodes

Post by scottwilkerson »

Make sure that cron service is running. It is normal for nagios to drop files there, but they should get picked up immediately and processed by the perfdataproc cron.
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
Endeavour Energy
Posts: 5
Joined: Thu Feb 15, 2018 9:42 pm

Re: Nagios XI generating lots of files using high inodes

Post by Endeavour Energy »

Hi,
Ran the below command to checked

service crond status

It is showing message crond (pid 2389) is working.

Shall i delete manually all the file generated in /usr/local/nagios/var/spool/xidpe

Please suggest
Endeavour Energy
Posts: 5
Joined: Thu Feb 15, 2018 9:42 pm

Re: Nagios XI generating lots of files using high inodes

Post by Endeavour Energy »

Hi,

On screen we are experiencing the below error.

SQL Error [ndoutils] : can't create/write to file /tmp/#sql_8fa_o.MYI

Thanks
Rajeev Anand
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Nagios XI generating lots of files using high inodes

Post by scottwilkerson »

is the disk full?

Code: Select all

df -h
If not what are the permissions on /tmp

Code: Select all

ls -ld /tmp
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
Endeavour Energy
Posts: 5
Joined: Thu Feb 15, 2018 9:42 pm

Re: Nagios XI generating lots of files using high inodes

Post by Endeavour Energy »

Hi,

Ran the below command and checked

service crond status

It is showing message crond (pid 2389) is working.

Shall i delete manually all the file generated in /usr/local/nagios/var/spool/xidpe.

inode is 100% full.

Please suggest
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Nagios XI generating lots of files using high inodes

Post by scottwilkerson »

Endeavour Energy wrote:Shall i delete manually all the file generated in /usr/local/nagios/var/spool/xidpe.

inode is 100% full.
yes, but then you are going to want to see why this cron job isn't running.

Report the following

Code: Select all

chage -l nagios
tail -50 /var/log/cron
tail -50 /usr/local/nagiosxi/var/perfdataproc.log
Have you made any configuration mods lately like trying to install a ramdisk or anything like that?
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
Endeavour Energy
Posts: 5
Joined: Thu Feb 15, 2018 9:42 pm

Re: Nagios XI generating lots of files using high inodes

Post by Endeavour Energy »

Hi

Result of below commands is attached as screenshot
chage -l nagios
tail -50 /var/log/cron
tail -50 /usr/local/nagiosxi/var/perfdataproc.log

Thanks
Rajeev
You do not have the required permissions to view the files attached to this post.
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Nagios XI generating lots of files using high inodes

Post by scottwilkerson »

Ok so there are several problems, first the password is expired for the Nagios user.

You should run the following

Code: Select all

chage -m 0 -M 99999 -I -1 -E -1 nagios
Second, you are out of disk space again but this should resolve once you fix the password ageing.
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
Locked