Page 1 of 1

Snapshot stuck in "IN_PROGRESS" - can't delete

Posted: Wed Dec 30, 2015 1:03 pm
by mike4vr
We have a snapshot "logstash-2015.12.08" that is stuck in "IN_PROGRESS" mode. I've tried deleting it, but it won't work. I've also tried resetting all jobs, but that makes no difference either. Any troubleshooting steps I can take to resolve this and get my snanpshots working again?

I've tried "touching" a file as the nagios user in the repository directory and it works fine. So, I'm sure this is not a permission issue.

Re: Snapshot stuck in "IN_PROGRESS" - can't delete

Posted: Wed Dec 30, 2015 2:20 pm
by jolson
Are you capable of deleting files from the backup directory as the 'nagios' user? I recommend jumping over to your backup directory and deleting the appropriate file:

Code: Select all

cd /mnt/nlsbackup/indices
rm -rf logstash-2015.12.02
That should take care of the partial index backup - adjust the index name to be certain you're removing the bad index. Also you'll want to delete any snapshot- or metadata- files that match the same index name from /mnt/nlsbackup.

Let me know if that helps. Thanks!

Re: Snapshot stuck in "IN_PROGRESS" - can't delete

Posted: Wed Dec 30, 2015 3:40 pm
by mike4vr
Thank you. Do you recommend deleting all partial backups?

Re: Snapshot stuck in "IN_PROGRESS" - can't delete

Posted: Wed Dec 30, 2015 4:06 pm
by jolson
If you're on an older version of Nagios Log Server (<1.4.0) I recommend deleting all PARTIAL or FAILED backups entirely. The old version of our backup system could not self-delete.

What I highly recommend is updating to Nagios Log Server version 1.4.0 - we redesigned the backup system to be more fault-tolerant and self-sustainable. The new system also synchronously backs up your indices, which can improve backup speeds as well.

The new version can be downloaded here: https://www.nagios.com/downloads/nagios ... ver-source

Thanks!


Jesse

Re: Snapshot stuck in "IN_PROGRESS" - can't delete

Posted: Wed Dec 30, 2015 4:25 pm
by mike4vr
Thanks. We are already up-to-date with 1.4.0. I believe I've cleared the issue with your suggestion.

Re: Snapshot stuck in "IN_PROGRESS" - can't delete

Posted: Sun Jan 03, 2016 6:56 pm
by tmcdonald
Are we all set to close this up then?