Log Server Backup Snapshots no getting created

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
oxigenservices
Posts: 15
Joined: Tue Sep 27, 2016 5:26 am

Log Server Backup Snapshots no getting created

Post by oxigenservices »

Hi, I have query regarding configuration of backup and Maintenance Jobs. Attached is the configuration settings of Maintenance and Repository. The Closing and Deleting of indexes are working as per configuration but there are no backup snapshots in repository getting created.

The Server had live indexes of last 60 days prior to the Maintenance Jobs, I have enabled. Now the server is showing 15 days live indexes + 15 days closed indexes but no snapshots of indexes was created prior to 30 days.
rkennedy
Posts: 6579
Joined: Mon Oct 05, 2015 11:45 am

Re: Log Server Backup Snapshots no getting created

Post by rkennedy »

It looks like your screenshot didn't post, could you upload it once again?
Former Nagios Employee
oxigenservices
Posts: 15
Joined: Tue Sep 27, 2016 5:26 am

Re: Log Server Backup Snapshots no getting created

Post by oxigenservices »

Backup jobs.JPG
You do not have the required permissions to view the files attached to this post.
rkennedy
Posts: 6579
Joined: Mon Oct 05, 2015 11:45 am

Re: Log Server Backup Snapshots no getting created

Post by rkennedy »

Usually this is related to permissions. Please run the following commands, and send over the full output -

Code: Select all

ls -al /Archive
su - nagios
touch /Archive/test
Former Nagios Employee
oxigenservices
Posts: 15
Joined: Tue Sep 27, 2016 5:26 am

Re: Log Server Backup Snapshots no getting created

Post by oxigenservices »

Please note below the output.
total 16
drwxrwxrwx. 3 root root 4096 Oct 14 13:32 .
dr-xr-xr-x. 24 root root 4096 Oct 14 13:40 ..
-rw-r--r--. 1 nagios users 0 Oct 7 22:22 index
drwxr-xr-x. 17 nagios users 4096 Oct 7 22:02 indices
-rw-r--r--. 1 nagios users 461 Oct 7 22:02 metadata-curator-20161007163256
-rw-r--r--. 1 nagios users 0 Oct 7 22:22 snapshot-curator-20161007163256
-rw-r--r--. 1 nagios users 0 Oct 14 13:32 test
archive.png
You do not have the required permissions to view the files attached to this post.
User avatar
mcapra
Posts: 3739
Joined: Thu May 05, 2016 3:54 pm

Re: Log Server Backup Snapshots no getting created

Post by mcapra »

Can you share the output of the following command (it may be quite long, sending it to a file might make sense):

Code: Select all

curator --debug snapshot --repository LocalArchive indices --older-than 1 --time-unit days --timestring %Y.%m.%d
Former Nagios employee
https://www.mcapra.com/
oxigenservices
Posts: 15
Joined: Tue Sep 27, 2016 5:26 am

Re: Log Server Backup Snapshots no getting created

Post by oxigenservices »

Sorry for Delay in Response. Please find attached the curator output.
logs.txt
You do not have the required permissions to view the files attached to this post.
rkennedy
Posts: 6579
Joined: Mon Oct 05, 2015 11:45 am

Re: Log Server Backup Snapshots no getting created

Post by rkennedy »

Looks like it's failing to get a list here -

Code: Select all

2016-10-18 15:07:33,500 WARNING            elasticsearch       log_request_fail:82   GET /_snapshot/LocalArchive/_all [status:400 request:0.154s]
2016-10-18 15:07:33,500 DEBUG              elasticsearch       log_request_fail:90   > None
2016-10-18 15:07:33,500 ERROR          curator.api.utils          get_snapshots:254  Unable to find all snapshots in repository: LocalArchive
What is the full output from the following?

Code: Select all

curl -v -GET 127.0.0.1:9200/_snapshot/LocalArchive/_all
Former Nagios Employee
oxigenservices
Posts: 15
Joined: Tue Sep 27, 2016 5:26 am

Re: Log Server Backup Snapshots no getting created

Post by oxigenservices »

Please note below output.
curl Output.png
You do not have the required permissions to view the files attached to this post.
rkennedy
Posts: 6579
Joined: Mon Oct 05, 2015 11:45 am

Re: Log Server Backup Snapshots no getting created

Post by rkennedy »

It looks like the repository is corrupted some how. Could you delete all contents of the repository on the system, and then delete -> create once again on the NLS interface?

This should fix it up, if not, please run the following command once again and post back the result.
Former Nagios Employee
Locked