This support forum board is for support questions relating to
Nagios Log Server , our solution for managing and monitoring critical log data.
roddergreg
Posts: 59 Joined: Wed Oct 22, 2014 4:35 am
Post
by roddergreg » Thu Aug 11, 2016 8:06 am
curl -XGET '127.0.0.1:9200/_snapshot/logserverbackups':
{"logserverbackups":{"type":"fs","settings":{"compress":"true","location":"/usr/
curl -XGET '127.0.0.1:9200/_snapshot/logserverbackups/_all':
{"error":"ElasticsearchParseException[Failed to derive xcontent from (offset=0, length=0): []]","status":400}
rkennedy
Posts: 6579 Joined: Mon Oct 05, 2015 11:45 am
Post
by rkennedy » Thu Aug 11, 2016 1:36 pm
{"logserverbackups":{"type":"fs","settings":{"compress":"true","location":"/usr/
Was this the full output from the command?
I'm a bit concerned if so. It should show the full path, but it looks like yours is getting cutoff at /usr/ and not respecting the path you've set.
Code: Select all
[root@localhost US]# curl -XGET '127.0.0.1:9200/_snapshot/logserverbacurl -XGET '127.0.0.1:9200/_snapshot/nls'
{"nls":{"type":"fs","settings":{"compress":"true","location":"/usr/local/nagioslogserver/logserverbackups"}}}
Former Nagios Employee
roddergreg
Posts: 59 Joined: Wed Oct 22, 2014 4:35 am
Post
by roddergreg » Tue Aug 16, 2016 8:34 am
Code: Select all
gcooper@wmsyslog1-prd # curl -XGET '127.0.0.1:9200/_snapshot/logserverbackups'
{"logserverbackups":{"type":"fs","settings":{"compress":"true","location":"/usr/local/nagioslogserver/logserverbackups"}}}gcooper@wmsyslog1-prd #
Code: Select all
cooper@wmsyslog1-prd # curl -XGET '127.0.0.1:9200/_snapshot/logserverbackups/_all'
{"error":"ElasticsearchParseException[Failed to derive xcontent from (offset=0, length=0): []]","status":400}
This is the full output.
rkennedy
Posts: 6579 Joined: Mon Oct 05, 2015 11:45 am
Post
by rkennedy » Tue Aug 16, 2016 2:27 pm
Is submitting a ticket in an option for you? This might be better handled over a remote at this point.
Former Nagios Employee
roddergreg
Posts: 59 Joined: Wed Oct 22, 2014 4:35 am
Post
by roddergreg » Wed Aug 17, 2016 8:16 am
I believe our support plan only covers planned maintenance (upgrades etc.) We do not have customer support in our contract agreement.
mcapra
Posts: 3739 Joined: Thu May 05, 2016 3:54 pm
Post
by mcapra » Wed Aug 17, 2016 12:12 pm
It looks like one of your snapshots is corrupted. Not quite sure how that happened (this can result from a lack of disk space), but I think the best course of action is to clear out the repository completely. There doesn't exist an easy way to identify which individual snapshot is corrupted.
Before we fully commit to that, can you share the output of:
Code: Select all
curator --dry-run delete snapshots --repository logserverbackups --all-snapshots
roddergreg
Posts: 59 Joined: Wed Oct 22, 2014 4:35 am
Post
by roddergreg » Thu Aug 18, 2016 9:04 am
uid=44371(nagios) gid=100(users) groups=100(users),48(apache),1000(nagios)
[nagios@wmsyslog1-prd ~]$ curator --dry-run delete snapshots --repository logserverbackups --all-snapshots
2016-08-18 10:04:30,387 INFO Job starting: delete snapshots
2016-08-18 10:04:30,387 INFO DRY RUN MODE. No changes will be made.
2016-08-18 10:04:30,608 ERROR Unable to find all snapshots in repository: logserverbackups
2016-08-18 10:04:30,608 ERROR No snapshots found in Elasticsearch.
mcapra
Posts: 3739 Joined: Thu May 05, 2016 3:54 pm
Post
by mcapra » Thu Aug 18, 2016 9:52 am
Very strange behavior. Can you share the output of:
Code: Select all
ls -al /usr/local/nagioslogserver/logserverbackups/
roddergreg
Posts: 59 Joined: Wed Oct 22, 2014 4:35 am
Post
by roddergreg » Thu Aug 18, 2016 10:33 am
I deleted all the files in /usr/local/nagioslogserver/logserverbackups since you spoke of corruption. We have tape backups anyway. Can you post the default config file for eleasticsearch.yml? I think i might have changed this file when the problems started.
/usr/local/nagioslogserver/elasticsearch/config/elasticsearch.yaml.
Please add as attachment and I'll replace what i currently have in place.
Greg
mcapra
Posts: 3739 Joined: Thu May 05, 2016 3:54 pm
Post
by mcapra » Thu Aug 18, 2016 1:49 pm
Here's my elasticsearch.yml, not sure if the yaml was a typo. Had to upload as txt due to forum restrictions; Make sure you change the extension!
You do not have the required permissions to view the files attached to this post.