Page 1 of 1

Server not running, Disc Space full of old Indexes

Posted: Mon Dec 29, 2014 11:39 am
by Mossx
Hello,

I install Nagios Log Server manually on CentOS.

Everything was going great, I left for the weekend only to find it not working.
It looks like the disk is full, and I was having trouble with it automatically deleting indexes (despite it being set to delete indexes older the 2 days in the maintenance and backup)

My first question: is there anyway to delete indexes manually from the command line so I can get the server back up?

Second question: what could be causing the issue where the server does not delete old indexes?

Thanks for any help you can provide.

Re: Server not running, Disc Space full of old Indexes

Posted: Mon Dec 29, 2014 11:58 am
by scottwilkerson
You should be able to delete them through the UI, however you may need to free a little space to be able to get it the UI up and running.

Here's what I would suggest to free up some space

Code: Select all

service logstash stop
service elasticsearch stop
rm -rf /var/log/elasticsearch/*/*.log*
cat /dev/null > /var/log/logstash/logstash.log
service elasticsearch start
Wait a minute for it to load, then delete indexes manually through Admin -> Manage Indexes

Then

Code: Select all

service logstash start
Finally, lets verify what the settings are on the backup and maintenance page, can you post a screenshot?

Re: Server not running, Disc Space full of old Indexes

Posted: Mon Dec 29, 2014 12:10 pm
by Mossx
That worked out great, thank you.

Here's the screen shot of the backup and maintenance page settings.

Re: Server not running, Disc Space full of old Indexes

Posted: Mon Dec 29, 2014 2:07 pm
by tgriep
It looks like you have not setup a Backup Repository, below is the link on how to create one.
If you choose a drive with more free space, you shouldn't have any more problems.

http://assets.nagios.com/downloads/nagi ... enance.pdf

Re: Server not running, Disc Space full of old Indexes

Posted: Mon Dec 29, 2014 2:35 pm
by Mossx
Thanks again, we'll see what happens over the next few days.

Re: Server not running, Disc Space full of old Indexes

Posted: Mon Dec 29, 2014 2:59 pm
by sreinhardt
Sounds great!