Page 2 of 4
Re: NLS Backups not showing in Web UI Since upgrade to NLS 1
Posted: Mon Aug 08, 2016 1:13 pm
by rkennedy
Ack, the directory confused me this morning for whatever reason. Nice catch on my mistake.
Your permissions look good, lets try to test curator. Please run the follow (specifically as the nagios user which is why I'm throwing the su in) -
Code: Select all
su nagios
curator snapshot --repository logserverbackups indices --all-indices
Let us know what that returns.
Re: NLS Backups not showing in Web UI Since upgrade to NLS 1
Posted: Tue Aug 09, 2016 9:14 am
by roddergreg
Code: Select all
gcooper@wmsyslog1-prd # id
uid=44371(nagios) gid=100(users) groups=100(users),48(apache),1000(nagios)
gcooper@wmsyslog1-prd # curator snapshot --repository logserverbackups indices --all-indices
2016-08-09 10:13:33,820 INFO Job starting: snapshot indices
2016-08-09 10:13:33,821 WARNING Overriding default connection timeout. New timeout: 21600
2016-08-09 10:13:33,833 INFO Matching all indices. Ignoring flags other than --exclude.
2016-08-09 10:13:33,833 INFO Action snapshot will be performed on the following indices: [u'kibana-int', u'logstash-2016.07.10', u'logstash-2016.07.11', u'logstash-2016.07.12', u'logstash-2016.07.13', u'logstash-2016.07.14', u'logstash-2016.07.15', u'logstash-2016.07.16', u'logstash-2016.07.17', u'logstash-2016.07.18', u'logstash-2016.07.19', u'logstash-2016.07.20', u'logstash-2016.07.21', u'logstash-2016.07.22', u'logstash-2016.07.23', u'logstash-2016.07.24', u'logstash-2016.07.25', u'logstash-2016.07.26', u'logstash-2016.07.27', u'logstash-2016.07.28', u'logstash-2016.07.29', u'logstash-2016.07.30', u'logstash-2016.07.31', u'logstash-2016.08.01', u'logstash-2016.08.02', u'logstash-2016.08.03', u'logstash-2016.08.04', u'logstash-2016.08.05', u'logstash-2016.08.06', u'logstash-2016.08.07', u'logstash-2016.08.08', u'logstash-2016.08.09', u'nagioslogserver', u'nagioslogserver_log']
2016-08-09 10:13:36,874 INFO Snapshot name: curator-20160809141336
2016-08-09 10:13:37,135 ERROR Unable to find all snapshots in repository: logserverbackups
Traceback (most recent call last):
File "/bin/curator", line 11, in <module>
sys.exit(main())
File "/usr/lib/python2.7/site-packages/curator/curator.py", line 5, in main
cli( obj={ "filters": [] } )
File "/usr/lib/python2.7/site-packages/click/core.py", line 716, in __call__
return self.main(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/click/core.py", line 696, in main
rv = self.invoke(ctx)
File "/usr/lib/python2.7/site-packages/click/core.py", line 1060, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python2.7/site-packages/click/core.py", line 1060, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python2.7/site-packages/click/core.py", line 889, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/lib/python2.7/site-packages/click/core.py", line 534, in invoke
return callback(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/click/decorators.py", line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File "/usr/lib/python2.7/site-packages/curator/cli/index_selection.py", line 167, in indices
retval = do_command(client, ctx.parent.info_name, working_list, ctx.parent.params, master_timeout)
File "/usr/lib/python2.7/site-packages/curator/cli/utils.py", line 250, in do_command
skip_repo_validation=params['skip_repo_validation'],
File "/usr/lib/python2.7/site-packages/curator/api/snapshot.py", line 72, in create_snapshot
if name in all_snaps:
TypeError: argument of type 'bool' is not iterable
Re: NLS Backups not showing in Web UI Since upgrade to NLS 1
Posted: Tue Aug 09, 2016 9:22 am
by hsmith
What's in the logserverbackup directory?
Re: NLS Backups not showing in Web UI Since upgrade to NLS 1
Posted: Tue Aug 09, 2016 9:35 am
by roddergreg
Backup_Maintenance_ยท_Nagios_Log_Server_-_2016-08-09_10.33.02.png
Repository name is logserverbackups. The repository has been created as you can see on the attachment to point to /usr/local/nagioslogserver/logserverbackups
Re: NLS Backups not showing in Web UI Since upgrade to NLS 1
Posted: Tue Aug 09, 2016 9:40 am
by roddergreg
hsmith wrote:What's in the logserverbackup directory?
I already showed you in a previous post the ls -al of the /usr/local/nagioslogserver/logserverbackups. here is an ls /usr/local/nagioslogserver/logserverbackups for the sake of brevity.
Code: Select all
index metadata-curator-20160301192224 metadata-logstash-2015.09.10 metadata-logstash-2015.11.12 metadata-logstash-2016.01.06 snapshot-curator-20160302193401 snapshot-logstash-2015.09.11 snapshot-logstash-2015.11.13
indices metadata-curator-20160302193401 metadata-logstash-2015.09.11 metadata-logstash-2015.11.13 snapshot-curator-20160108033102 snapshot-curator-20160303194732 snapshot-logstash-2015.09.12 snapshot-logstash-2015.11.14
metadata-curator-20160108033102 metadata-curator-20160303194732 metadata-logstash-2015.09.12 metadata-logstash-2015.11.14 snapshot-curator-20160109035440 snapshot-curator-20160304203103 snapshot-logstash-2015.09.13 snapshot-logstash-2015.11.15
metadata-curator-20160109035440 metadata-curator-20160304203103 metadata-logstash-2015.09.13 metadata-logstash-2015.11.15 snapshot-curator-20160110040516 snapshot-curator-20160305204445 snapshot-logstash-2015.09.14 snapshot-logstash-2015.11.16
metadata-curator-20160110040516 metadata-curator-20160305204445 metadata-logstash-2015.09.14 metadata-logstash-2015.11.16 snapshot-curator-20160111041256 snapshot-curator-20160306205907 snapshot-logstash-2015.09.15 snapshot-logstash-2015.11.17
metadata-curator-20160111041256 metadata-curator-20160306205907 metadata-logstash-2015.09.15 metadata-logstash-2015.11.17 snapshot-curator-20160112042105 snapshot-curator-20160307211334 snapshot-logstash-2015.09.16 snapshot-logstash-2015.11.18
metadata-curator-20160112042105 metadata-curator-20160307211334 metadata-logstash-2015.09.16 metadata-logstash-2015.11.18 snapshot-curator-20160113043407 snapshot-curator-20160308212620 snapshot-logstash-2015.09.25 snapshot-logstash-2015.11.19
metadata-curator-20160113043407 metadata-curator-20160308212620 metadata-logstash-2015.09.25 metadata-logstash-2015.11.19 snapshot-curator-20160114092050 snapshot-curator-20160309213940 snapshot-logstash-2015.09.26 snapshot-logstash-2015.11.20
metadata-curator-20160114092050 metadata-curator-20160309213940 metadata-logstash-2015.09.26 metadata-logstash-2015.11.20 snapshot-curator-20160115093944 snapshot-curator-20160310215439 snapshot-logstash-2015.09.27 snapshot-logstash-2015.11.21
metadata-curator-20160115093944 metadata-curator-20160310215439 metadata-logstash-2015.09.27 metadata-logstash-2015.11.21 snapshot-curator-20160116095406 snapshot-curator-20160311220706 snapshot-logstash-2015.09.28 snapshot-logstash-2015.11.22
metadata-curator-20160116095406 metadata-curator-20160311220706 metadata-logstash-2015.09.28 metadata-logstash-2015.11.22 snapshot-curator-20160117101024 snapshot-curator-20160312221613 snapshot-logstash-2015.09.29 snapshot-logstash-2015.11.23
metadata-curator-20160117101024 metadata-curator-20160312221613 metadata-logstash-2015.09.29 metadata-logstash-2015.11.23 snapshot-curator-20160118102606 snapshot-curator-20160313222813 snapshot-logstash-2015.09.30 snapshot-logstash-2015.11.24
metadata-curator-20160118102606 metadata-curator-20160313222813 metadata-logstash-2015.09.30 metadata-logstash-2015.11.24 snapshot-curator-20160119104059 snapshot-curator-20160420192008 snapshot-logstash-2015.10.01 snapshot-logstash-2015.11.25
metadata-curator-20160119104059 metadata-curator-20160420192008 metadata-logstash-2015.10.01 metadata-logstash-2015.11.25 snapshot-curator-20160120105858 snapshot-curator-20160421194837 snapshot-logstash-2015.10.02 snapshot-logstash-2015.11.26
metadata-curator-20160120105858 metadata-curator-20160421194837 metadata-logstash-2015.10.02 metadata-logstash-2015.11.26 snapshot-curator-20160121111034 snapshot-curator-20160422195507 snapshot-logstash-2015.10.03 snapshot-logstash-2015.11.27
metadata-curator-20160121111034 metadata-curator-20160422195507 metadata-logstash-2015.10.03 metadata-logstash-2015.11.27 snapshot-curator-20160122112212 snapshot-curator-20160423200659 snapshot-logstash-2015.10.04 snapshot-logstash-2015.11.28
metadata-curator-20160122112212 metadata-curator-20160423200659 metadata-logstash-2015.10.04 metadata-logstash-2015.11.28 snapshot-curator-20160123113459 snapshot-curator-20160424201930 snapshot-logstash-2015.10.05 snapshot-logstash-2015.11.29
metadata-curator-20160123113459 metadata-curator-20160424201930 metadata-logstash-2015.10.05 metadata-logstash-2015.11.29 snapshot-curator-20160124114812 snapshot-curator-20160425203119 snapshot-logstash-2015.10.06 snapshot-logstash-2015.11.30
metadata-curator-20160124114812 metadata-curator-20160425203119 metadata-logstash-2015.10.06 metadata-logstash-2015.11.30 snapshot-curator-20160125115911 snapshot-curator-20160426204214 snapshot-logstash-2015.10.07 snapshot-logstash-2015.12.01
metadata-curator-20160125115911 metadata-curator-20160426204214 metadata-logstash-2015.10.07 metadata-logstash-2015.12.01 snapshot-curator-20160126120917 snapshot-curator-20160729135041 snapshot-logstash-2015.10.08 snapshot-logstash-2015.12.02
metadata-curator-20160126120917 metadata-curator-20160729135041 metadata-logstash-2015.10.08 metadata-logstash-2015.12.02 snapshot-curator-20160127123843 snapshot-logstash-2015.01.01 snapshot-logstash-2015.10.09 snapshot-logstash-2015.12.03
metadata-curator-20160127123843 metadata-logstash-2015.01.01 metadata-logstash-2015.10.09 metadata-logstash-2015.12.03 snapshot-curator-20160128130006 snapshot-logstash-2015.01.02 snapshot-logstash-2015.10.10 snapshot-logstash-2015.12.04
metadata-curator-20160128130006 metadata-logstash-2015.01.02 metadata-logstash-2015.10.10 metadata-logstash-2015.12.04 snapshot-curator-20160129131050 snapshot-logstash-2015.01.03 snapshot-logstash-2015.10.11 snapshot-logstash-2015.12.05
metadata-curator-20160129131050 metadata-logstash-2015.01.03 metadata-logstash-2015.10.11 metadata-logstash-2015.12.05 snapshot-curator-20160130132411 snapshot-logstash-2015.01.04 snapshot-logstash-2015.10.12 snapshot-logstash-2015.12.06
metadata-curator-20160130132411 metadata-logstash-2015.01.04 metadata-logstash-2015.10.12 metadata-logstash-2015.12.06 snapshot-curator-20160131134007 snapshot-logstash-2015.01.05 snapshot-logstash-2015.10.13 snapshot-logstash-2015.12.07
metadata-curator-20160131134007 metadata-logstash-2015.01.05 metadata-logstash-2015.10.13 metadata-logstash-2015.12.07 snapshot-curator-20160201135538 snapshot-logstash-2015.01.06 snapshot-logstash-2015.10.14 snapshot-logstash-2015.12.08
metadata-curator-20160201135538 metadata-logstash-2015.01.06 metadata-logstash-2015.10.14 metadata-logstash-2015.12.08 snapshot-curator-20160202140852 snapshot-logstash-2015.01.07 snapshot-logstash-2015.10.15 snapshot-logstash-2015.12.09
metadata-curator-20160202140852 metadata-logstash-2015.01.07 metadata-logstash-2015.10.15 metadata-logstash-2015.12.09 snapshot-curator-20160203142751 snapshot-logstash-2015.07.01 snapshot-logstash-2015.10.16 snapshot-logstash-2015.12.10
metadata-curator-20160203142751 metadata-logstash-2015.07.01 metadata-logstash-2015.10.16 metadata-logstash-2015.12.10 snapshot-curator-20160204143713 snapshot-logstash-2015.08.15 snapshot-logstash-2015.10.17 snapshot-logstash-2015.12.11
metadata-curator-20160204143713 metadata-logstash-2015.08.15 metadata-logstash-2015.10.17 metadata-logstash-2015.12.11 snapshot-curator-20160205144608 snapshot-logstash-2015.08.16 snapshot-logstash-2015.10.18 snapshot-logstash-2015.12.12
metadata-curator-20160205144608 metadata-logstash-2015.08.16 metadata-logstash-2015.10.18 metadata-logstash-2015.12.12 snapshot-curator-20160206145452 snapshot-logstash-2015.08.17 snapshot-logstash-2015.10.19 snapshot-logstash-2015.12.13
metadata-curator-20160206145452 metadata-logstash-2015.08.17 metadata-logstash-2015.10.19 metadata-logstash-2015.12.13 snapshot-curator-20160207150442 snapshot-logstash-2015.08.18 snapshot-logstash-2015.10.20 snapshot-logstash-2015.12.14
metadata-curator-20160207150442 metadata-logstash-2015.08.18 metadata-logstash-2015.10.20 metadata-logstash-2015.12.14 snapshot-curator-20160208151344 snapshot-logstash-2015.08.19 snapshot-logstash-2015.10.21 snapshot-logstash-2015.12.15
metadata-curator-20160208151344 metadata-logstash-2015.08.19 metadata-logstash-2015.10.21 metadata-logstash-2015.12.15 snapshot-curator-20160209152126 snapshot-logstash-2015.08.20 snapshot-logstash-2015.10.22 snapshot-logstash-2015.12.16
metadata-curator-20160209152126 metadata-logstash-2015.08.20 metadata-logstash-2015.10.22 metadata-logstash-2015.12.16 snapshot-curator-20160210153730 snapshot-logstash-2015.08.21 snapshot-logstash-2015.10.23 snapshot-logstash-2015.12.17
metadata-curator-20160210153730 metadata-logstash-2015.08.21 metadata-logstash-2015.10.23 metadata-logstash-2015.12.17 snapshot-curator-20160211154545 snapshot-logstash-2015.08.22 snapshot-logstash-2015.10.24 snapshot-logstash-2015.12.18
metadata-curator-20160211154545 metadata-logstash-2015.08.22 metadata-logstash-2015.10.24 metadata-logstash-2015.12.18 snapshot-curator-20160212155436 snapshot-logstash-2015.08.23 snapshot-logstash-2015.10.25 snapshot-logstash-2015.12.19
metadata-curator-20160212155436 metadata-logstash-2015.08.23 metadata-logstash-2015.10.25 metadata-logstash-2015.12.19 snapshot-curator-20160213160258 snapshot-logstash-2015.08.24 snapshot-logstash-2015.10.26 snapshot-logstash-2015.12.20
metadata-curator-20160213160258 metadata-logstash-2015.08.24 metadata-logstash-2015.10.26 metadata-logstash-2015.12.20 snapshot-curator-20160214160948 snapshot-logstash-2015.08.25 snapshot-logstash-2015.10.27 snapshot-logstash-2015.12.21
metadata-curator-20160214160948 metadata-logstash-2015.08.25 metadata-logstash-2015.10.27 metadata-logstash-2015.12.21 snapshot-curator-20160215161735 snapshot-logstash-2015.08.26 snapshot-logstash-2015.10.28 snapshot-logstash-2015.12.22
metadata-curator-20160215161735 metadata-logstash-2015.08.26 metadata-logstash-2015.10.28 metadata-logstash-2015.12.22 snapshot-curator-20160216162549 snapshot-logstash-2015.08.27 snapshot-logstash-2015.10.29 snapshot-logstash-2015.12.23
metadata-curator-20160216162549 metadata-logstash-2015.08.27 metadata-logstash-2015.10.29 metadata-logstash-2015.12.23 snapshot-curator-20160217163249 snapshot-logstash-2015.08.28 snapshot-logstash-2015.10.30 snapshot-logstash-2015.12.24
metadata-curator-20160217163249 metadata-logstash-2015.08.28 metadata-logstash-2015.10.30 metadata-logstash-2015.12.24 snapshot-curator-20160218164233 snapshot-logstash-2015.08.29 snapshot-logstash-2015.10.31 snapshot-logstash-2015.12.25
metadata-curator-20160218164233 metadata-logstash-2015.08.29 metadata-logstash-2015.10.31 metadata-logstash-2015.12.25 snapshot-curator-20160219165010 snapshot-logstash-2015.08.30 snapshot-logstash-2015.11.01 snapshot-logstash-2015.12.26
metadata-curator-20160219165010 metadata-logstash-2015.08.30 metadata-logstash-2015.11.01 metadata-logstash-2015.12.26 snapshot-curator-20160220170531 snapshot-logstash-2015.08.31 snapshot-logstash-2015.11.02 snapshot-logstash-2015.12.27
metadata-curator-20160220170531 metadata-logstash-2015.08.31 metadata-logstash-2015.11.02 metadata-logstash-2015.12.27 snapshot-curator-20160221171638 snapshot-logstash-2015.09.01 snapshot-logstash-2015.11.03 snapshot-logstash-2015.12.28
metadata-curator-20160221171638 metadata-logstash-2015.09.01 metadata-logstash-2015.11.03 metadata-logstash-2015.12.28 snapshot-curator-20160222172607 snapshot-logstash-2015.09.02 snapshot-logstash-2015.11.04 snapshot-logstash-2015.12.29
metadata-curator-20160222172607 metadata-logstash-2015.09.02 metadata-logstash-2015.11.04 metadata-logstash-2015.12.29 snapshot-curator-20160223173603 snapshot-logstash-2015.09.03 snapshot-logstash-2015.11.05 snapshot-logstash-2015.12.30
metadata-curator-20160223173603 metadata-logstash-2015.09.03 metadata-logstash-2015.11.05 metadata-logstash-2015.12.30 snapshot-curator-20160224174545 snapshot-logstash-2015.09.04 snapshot-logstash-2015.11.06 snapshot-logstash-2015.12.31
metadata-curator-20160224174545 metadata-logstash-2015.09.04 metadata-logstash-2015.11.06 metadata-logstash-2015.12.31 snapshot-curator-20160225180310 snapshot-logstash-2015.09.05 snapshot-logstash-2015.11.07 snapshot-logstash-2016.01.01
metadata-curator-20160225180310 metadata-logstash-2015.09.05 metadata-logstash-2015.11.07 metadata-logstash-2016.01.01 snapshot-curator-20160226181808 snapshot-logstash-2015.09.06 snapshot-logstash-2015.11.08 snapshot-logstash-2016.01.02
metadata-curator-20160226181808 metadata-logstash-2015.09.06 metadata-logstash-2015.11.08 metadata-logstash-2016.01.02 snapshot-curator-20160227183320 snapshot-logstash-2015.09.07 snapshot-logstash-2015.11.09 snapshot-logstash-2016.01.03
metadata-curator-20160227183320 metadata-logstash-2015.09.07 metadata-logstash-2015.11.09 metadata-logstash-2016.01.03 snapshot-curator-20160228185036 snapshot-logstash-2015.09.08 snapshot-logstash-2015.11.10 snapshot-logstash-2016.01.04
metadata-curator-20160228185036 metadata-logstash-2015.09.08 metadata-logstash-2015.11.10 metadata-logstash-2016.01.04 snapshot-curator-20160229190808 snapshot-logstash-2015.09.09 snapshot-logstash-2015.11.11 snapshot-logstash-2016.01.05
metadata-curator-20160229190808 metadata-logstash-2015.09.09 metadata-logstash-2015.11.11 metadata-logstash-2016.01.05 snapshot-curator-20160301192224 snapshot-logstash-2015.09.10 snapshot-logstash-2015.11.12 snapshot-logstash-2016.01.06
Re: NLS Backups not showing in Web UI Since upgrade to NLS 1
Posted: Tue Aug 09, 2016 9:42 am
by hsmith
Can you try to delete the repository in the UI (note this will not delete any files from the system) and readd it, and run the curator command once more?
Re: NLS Backups not showing in Web UI Since upgrade to NLS 1
Posted: Tue Aug 09, 2016 10:26 am
by roddergreg
Deleted logserverbackups repo and re-created - problem persist.
Deleted and made a new repository (nls-backups)pointing to the correct filesystem - problem persist.
2016-08-09 11:26:29,469 INFO Snapshot name: curator-20160809152629
2016-08-09 11:26:29,700 ERROR Unable to find all snapshots in repository: logserverbackups
Traceback (most recent call last):
File "/bin/curator", line 11, in <module>
sys.exit(main())
File "/usr/lib/python2.7/site-packages/curator/curator.py", line 5, in main
cli( obj={ "filters": [] } )
File "/usr/lib/python2.7/site-packages/click/core.py", line 716, in __call__
return self.main(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/click/core.py", line 696, in main
rv = self.invoke(ctx)
File "/usr/lib/python2.7/site-packages/click/core.py", line 1060, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python2.7/site-packages/click/core.py", line 1060, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python2.7/site-packages/click/core.py", line 889, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/lib/python2.7/site-packages/click/core.py", line 534, in invoke
return callback(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/click/decorators.py", line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File "/usr/lib/python2.7/site-packages/curator/cli/index_selection.py", line 167, in indices
retval = do_command(client, ctx.parent.info_name, working_list, ctx.parent.params, master_timeout)
File "/usr/lib/python2.7/site-packages/curator/cli/utils.py", line 250, in do_command
skip_repo_validation=params['skip_repo_validation'],
File "/usr/lib/python2.7/site-packages/curator/api/snapshot.py", line 72, in create_snapshot
if name in all_snaps:
TypeError: argument of type 'bool' is not iterable
Re: NLS Backups not showing in Web UI Since upgrade to NLS 1
Posted: Tue Aug 09, 2016 10:45 am
by hsmith
Let's run that curator command, with the debug flag this time:
Code: Select all
curator --debug snapshot --repository logserverbackups indices --all-indices
Re: NLS Backups not showing in Web UI Since upgrade to NLS 1
Posted: Wed Aug 10, 2016 7:59 am
by roddergreg
Attachment includes output from the debug command.
Re: NLS Backups not showing in Web UI Since upgrade to NLS 1
Posted: Wed Aug 10, 2016 2:18 pm
by rkennedy
Looks like we're getting closer -
2016-08-10 08:56:27,692 WARNING elasticsearch log_request_fail:82 GET /_snapshot/logserverbackups/_all [status:400 request:0.297s]
What is the output of these commands?
Code: Select all
curl -XGET '127.0.0.1:9200/_snapshot/logserverbackups'
curl -XGET '127.0.0.1:9200/_snapshot/logserverbackups/_all'