Snapshot stuck in "IN_PROGRESS" - can't delete

[mike4vr]

We have a snapshot "logstash-2015.12.08" that is stuck in "IN_PROGRESS" mode. I've tried deleting it, but it won't work. I've also tried resetting all jobs, but that makes no difference either. Any troubleshooting steps I can take to resolve this and get my snanpshots working again?

I've tried "touching" a file as the nagios user in the repository directory and it works fine. So, I'm sure this is not a permission issue.

[jolson]

Are you capable of deleting files from the backup directory as the 'nagios' user? I recommend jumping over to your backup directory and deleting the appropriate file:

Code: Select all

cd /mnt/nlsbackup/indices
rm -rf logstash-2015.12.02

That should take care of the partial index backup - adjust the index name to be certain you're removing the bad index. Also you'll want to delete any snapshot- or metadata- files that match the same index name from /mnt/nlsbackup.

Let me know if that helps. Thanks!

[mike4vr]

Thank you. Do you recommend deleting all partial backups?

[jolson]

If you're on an older version of Nagios Log Server (<1.4.0) I recommend deleting all PARTIAL or FAILED backups entirely. The old version of our backup system could not self-delete.

What I highly recommend is updating to Nagios Log Server version 1.4.0 - we redesigned the backup system to be more fault-tolerant and self-sustainable. The new system also synchronously backs up your indices, which can improve backup speeds as well.

The new version can be downloaded here: https://www.nagios.com/downloads/nagios ... ver-source

Thanks!


Jesse

[mike4vr]

Thanks. We are already up-to-date with 1.4.0. I believe I've cleared the issue with your suggestion.

[tmcdonald]

Are we all set to close this up then?