Backup Repository

[scottwilkerson]

Run the following and it will output a number that is the timestamp @ the next midnight in your timezone

Code: Select all

echo "<?php echo strtotime('tomorrow midnight').\"\n\"; ?>"|php

Copy that number and run the following command replacing the 10 after run_time with that number

Code: Select all

curl -XPOST localhost:9200/nagioslogserver/commands/2VqRrvugSKe0xM1fzzKcJA/_update -d '{ "doc": { "run_time": "10" } }' 

This will set it to kickoff the job at midnight.

We do plan on adding some management in the UI for jobs so they can be edited.

[stecino]

Run the following and it will output a number that is the timestamp @ the next midnight in your timezone

Code: Select all

echo "<?php echo strtotime('tomorrow midnight').\"\n\"; ?>"|php

Copy that number and run the following command replacing the 10 after run_time with that number

Code: Select all

curl -XPOST localhost:9200/nagioslogserver/commands/2VqRrvugSKe0xM1fzzKcJA/_update -d '{ "doc": { "run_time": "10" } }' 

This will set it to kickoff the job at midnight.

We do plan on adding some management in the UI for jobs so they can be edited.

Hello, my backups were good until I updated to version 1.3

In the command subsystem tab, I see

URScqqg3Rl6rdxRuDOznZw
(Runs do_backups)

Before upgrade, I would kickoff the backup with

curl -XPOST localhost:9200/nagioslogserver/commands/2VqRrvugSKe0xM1fzzKcJA/_update -d '{ "doc": { "run_time": "10" } }'

Now I tried to use the new system job id above, but it's still not working. Haven't been able to generate index backup for 2 weeks now

Although it shows that it ran last 1am.

URScqqg3Rl6rdxRuDOznZw Waiting SUCCESS 03/17/2015 01:00:07 1 day 03/18/2015 01:00:07 System

[jolson]

What happens when you tail your job logs:

Code: Select all

tail -f /usr/local/nagioslogserver/var/jobs.log

And perform a job from the command subsystem in the GUI? Click the 'Edit' button and set the next run time to 'Now.' Press Update. What do you get in the jobs.log? Keep in mind that the jobs.log will only fill up a few of the nodes in your cluster - so you will want to run the tail on every node before attempting to issue the command.

[stecino]

What happens when you tail your job logs:

Code: Select all

tail -f /usr/local/nagioslogserver/var/jobs.log

And perform a job from the command subsystem in the GUI? Click the 'Edit' button and set the next run time to 'Now.' Press Update. What do you get in the jobs.log? Keep in mind that the jobs.log will only fill up a few of the nodes in your cluster - so you will want to run the tail on every node before attempting to issue the command.

I ran this explicitly

curl -XPOST localhost:9200/nagioslogserver/commands/URScqqg3Rl6rdxRuDOznZw/_update -d '{ "doc": { "run_time": "10" } }'

[root@pden2nls1 scripts]# tail -f /usr/local/nagioslogserver/var/jobs.log
Processed 0 node jobs.
Processed 0 global jobs.
tail: /usr/local/nagioslogserver/var/jobs.log: file truncated
Processed 0 node jobs.
Processed 0 global jobs.
tail: /usr/local/nagioslogserver/var/jobs.log: file truncated
Processed 0 node jobs.
Processed 0 global jobs.
tail: /usr/local/nagioslogserver/var/jobs.log: file truncated


Nothing is processed


Job ID Job Status Last Run Status Last Run Time Frequency Next Run Time Type Actions
hQzM7yyKSJGPqd2UIRB4xA Waiting SUCCESS 03/17/2015 15:25:42 1 hour 03/17/2015 16:25:42 System Edit
URScqqg3Rl6rdxRuDOznZw Waiting SUCCESS 03/17/2015 01:00:07 1 day 03/18/2015 01:00:07 System Edit
2VqRrvugSKe0xM1fzzKcJA Waiting SUCCESS 03/17/2015 16:12:16 1 day 03/18/2015 16:12:16 System Edit
TFP1dnsTSd6C-XrbJup5GA Running SUCCESS 02/04/2015 19:56:31 20 seconds 02/04/2015 19:56:51 System Edit
V92d-I5KQrmDoDgaC4PV6A Waiting SUCCESS 03/16/2015 18:05:22 1 day 03/17/2015 18:05:22 System Edit

[jolson]

Did you tail every node while you ran that job? Only one or two nodes will provide the needed output.

[stecino]

Did you tail every node while you ran that job? Only one or two nodes will provide the needed output.

curl -XPOST localhost:9200/nagioslogserver/commands/URScqqg3Rl6rdxRuDOznZw/_update -d '{ "doc": { "run_time": "10" } }'


Running command do_backups with args ' ' for job id: URScqqg3Rl6rdxRuDOznZw
SUCCESS
Processed 0 node jobs.
Processed 1 global jobs.

But then I ran this, and it seems to optimizing the index and not backing things up? Prior to the upgrade I would use this command to backup. Is it possible that my job IDs are somehow changed?

curl -XPOST localhost:9200/nagioslogserver/commands/2VqRrvugSKe0xM1fzzKcJA/_update -d '{ "doc": { "run_time": "10" } }'

2VqRrvugSKe0xM1fzzKcJA
(Runs do_maintenance)

Code: Select all

Running command do_maintenance with args ' ' for job id: 2VqRrvugSKe0xM1fzzKcJA
2015-03-18 10:08:17,091 INFO      Job starting...
2015-03-18 10:08:17,121 INFO      Beginning BLOOM operations...
2015-03-18 10:08:17,150 INFO      Attempting to disable bloom filter for index logstash-2015.02.17.
2015-03-18 10:08:17,588 INFO      logstash-2015.02.17: Successfully bloom filter disabled.
2015-03-18 10:08:17,588 INFO      Attempting to disable bloom filter for index logstash-2015.02.18.
2015-03-18 10:08:17,988 INFO      logstash-2015.02.18: Successfully bloom filter disabled.
2015-03-18 10:08:17,988 INFO      Attempting to disable bloom filter for index logstash-2015.02.19.
2015-03-18 10:08:18,364 INFO      logstash-2015.02.19: Successfully bloom filter disabled.
2015-03-18 10:08:18,365 INFO      Attempting to disable bloom filter for index logstash-2015.02.20.
2015-03-18 10:08:18,742 INFO      logstash-2015.02.20: Successfully bloom filter disabled.
2015-03-18 10:08:18,742 INFO      Attempting to disable bloom filter for index logstash-2015.02.21.
2015-03-18 10:08:19,120 INFO      logstash-2015.02.21: Successfully bloom filter disabled.
2015-03-18 10:08:19,121 INFO      Attempting to disable bloom filter for index logstash-2015.02.22.
2015-03-18 10:08:19,502 INFO      logstash-2015.02.22: Successfully bloom filter disabled.
2015-03-18 10:08:19,503 INFO      Attempting to disable bloom filter for index logstash-2015.02.23.
2015-03-18 10:08:19,900 INFO      logstash-2015.02.23: Successfully bloom filter disabled.
2015-03-18 10:08:19,901 INFO      Attempting to disable bloom filter for index logstash-2015.02.24.
2015-03-18 10:08:20,263 INFO      logstash-2015.02.24: Successfully bloom filter disabled.
2015-03-18 10:08:20,264 INFO      Attempting to disable bloom filter for index logstash-2015.02.25.
2015-03-18 10:08:20,406 INFO      logstash-2015.02.25: Successfully bloom filter disabled.
2015-03-18 10:08:20,406 INFO      Attempting to disable bloom filter for index logstash-2015.02.26.
2015-03-18 10:08:20,607 INFO      logstash-2015.02.26: Successfully bloom filter disabled.
2015-03-18 10:08:20,608 INFO      Attempting to disable bloom filter for index logstash-2015.02.27.
2015-03-18 10:08:21,003 INFO      logstash-2015.02.27: Successfully bloom filter disabled.
2015-03-18 10:08:21,003 INFO      Attempting to disable bloom filter for index logstash-2015.02.28.
2015-03-18 10:08:21,430 INFO      logstash-2015.02.28: Successfully bloom filter disabled.
2015-03-18 10:08:21,430 INFO      Attempting to disable bloom filter for index logstash-2015.03.01.
2015-03-18 10:08:21,799 INFO      logstash-2015.03.01: Successfully bloom filter disabled.
2015-03-18 10:08:21,799 INFO      Attempting to disable bloom filter for index logstash-2015.03.02.
2015-03-18 10:08:22,176 INFO      logstash-2015.03.02: Successfully bloom filter disabled.
2015-03-18 10:08:22,177 INFO      Attempting to disable bloom filter for index logstash-2015.03.03.
2015-03-18 10:08:22,542 INFO      logstash-2015.03.03: Successfully bloom filter disabled.
2015-03-18 10:08:22,542 INFO      Attempting to disable bloom filter for index logstash-2015.03.04.
2015-03-18 10:08:22,939 INFO      logstash-2015.03.04: Successfully bloom filter disabled.
2015-03-18 10:08:22,939 INFO      Attempting to disable bloom filter for index logstash-2015.03.05.
2015-03-18 10:08:23,330 INFO      logstash-2015.03.05: Successfully bloom filter disabled.
2015-03-18 10:08:23,330 INFO      Attempting to disable bloom filter for index logstash-2015.03.06.
2015-03-18 10:08:23,777 INFO      logstash-2015.03.06: Successfully bloom filter disabled.
2015-03-18 10:08:23,777 INFO      Attempting to disable bloom filter for index logstash-2015.03.07.
2015-03-18 10:08:24,133 INFO      logstash-2015.03.07: Successfully bloom filter disabled.
2015-03-18 10:08:24,134 INFO      Attempting to disable bloom filter for index logstash-2015.03.08.
2015-03-18 10:08:24,491 INFO      logstash-2015.03.08: Successfully bloom filter disabled.
2015-03-18 10:08:24,492 INFO      Attempting to disable bloom filter for index logstash-2015.03.09.
2015-03-18 10:08:24,879 INFO      logstash-2015.03.09: Successfully bloom filter disabled.
2015-03-18 10:08:24,880 INFO      Attempting to disable bloom filter for index logstash-2015.03.10.
2015-03-18 10:08:25,256 INFO      logstash-2015.03.10: Successfully bloom filter disabled.
2015-03-18 10:08:25,256 INFO      Attempting to disable bloom filter for index logstash-2015.03.11.
2015-03-18 10:08:25,675 INFO      logstash-2015.03.11: Successfully bloom filter disabled.
2015-03-18 10:08:25,675 INFO      Attempting to disable bloom filter for index logstash-2015.03.12.
2015-03-18 10:08:26,088 INFO      logstash-2015.03.12: Successfully bloom filter disabled.
2015-03-18 10:08:26,088 INFO      Attempting to disable bloom filter for index logstash-2015.03.13.
2015-03-18 10:08:26,485 INFO      logstash-2015.03.13: Successfully bloom filter disabled.
2015-03-18 10:08:26,485 INFO      Attempting to disable bloom filter for index logstash-2015.03.14.
2015-03-18 10:08:26,877 INFO      logstash-2015.03.14: Successfully bloom filter disabled.
2015-03-18 10:08:26,878 INFO      Attempting to disable bloom filter for index logstash-2015.03.15.
2015-03-18 10:08:27,260 INFO      logstash-2015.03.15: Successfully bloom filter disabled.
2015-03-18 10:08:27,261 INFO      Attempting to disable bloom filter for index logstash-2015.03.16.
2015-03-18 10:08:27,621 INFO      logstash-2015.03.16: Successfully bloom filter disabled.
2015-03-18 10:08:27,621 INFO      Attempting to disable bloom filter for index logstash-2015.03.17.
2015-03-18 10:08:28,026 INFO      logstash-2015.03.17: Successfully bloom filter disabled.
2015-03-18 10:08:28,027 INFO      logstash-2015.03.18 is within the threshold period (1 days).
2015-03-18 10:08:28,027 INFO      logstash-2015.03.19 is within the threshold period (1 days).
2015-03-18 10:08:28,027 INFO      DISABLE BLOOM FILTER index operations completed.
2015-03-18 10:08:28,028 INFO      Done in 0:00:10.961716.
2015-03-18 10:08:28,396 INFO      Job starting...
2015-03-18 10:08:28,397 INFO      Default timeout of 30 seconds is too low for command OPTIMIZE.  Overriding to 21,600 seconds (6 hours).
2015-03-18 10:08:28,405 INFO      Beginning OPTIMIZE operations...
2015-03-18 10:08:28,434 INFO      Attempting to optimize index logstash-2015.02.17.
2015-03-18 10:08:28,465 INFO      Job starting...
2015-03-18 10:08:28,472 INFO      Beginning CLOSE operations...
2015-03-18 10:08:28,499 INFO      Job starting...
2015-03-18 10:08:28,504 INFO      logstash-2015.02.17 is within the threshold period (30 days).
2015-03-18 10:08:28,505 INFO      logstash-2015.02.18 is within the threshold period (30 days).
2015-03-18 10:08:28,505 INFO      logstash-2015.02.19 is within the threshold period (30 days).
2015-03-18 10:08:28,505 INFO      Beginning DELETE operations...
2015-03-18 10:08:28,505 INFO      logstash-2015.02.20 is within the threshold period (30 days).
2015-03-18 10:08:28,506 INFO      logstash-2015.02.21 is within the threshold period (30 days).
2015-03-18 10:08:28,506 INFO      logstash-2015.02.22 is within the threshold period (30 days).
2015-03-18 10:08:28,506 INFO      logstash-2015.02.23 is within the threshold period (30 days).
2015-03-18 10:08:28,507 INFO      logstash-2015.02.24 is within the threshold period (30 days).
2015-03-18 10:08:28,507 INFO      logstash-2015.02.25 is within the threshold period (30 days).
2015-03-18 10:08:28,508 INFO      logstash-2015.02.26 is within the threshold period (30 days).
2015-03-18 10:08:28,508 INFO      logstash-2015.02.27 is within the threshold period (30 days).
2015-03-18 10:08:28,508 INFO      logstash-2015.02.28 is within the threshold period (30 days).
2015-03-18 10:08:28,509 INFO      logstash-2015.03.01 is within the threshold period (30 days).
2015-03-18 10:08:28,509 INFO      logstash-2015.03.02 is within the threshold period (30 days).
2015-03-18 10:08:28,509 INFO      logstash-2015.03.03 is within the threshold period (30 days).
2015-03-18 10:08:28,510 INFO      logstash-2015.03.04 is within the threshold period (30 days).
2015-03-18 10:08:28,510 INFO      logstash-2015.03.05 is within the threshold period (30 days).
2015-03-18 10:08:28,510 INFO      logstash-2015.03.06 is within the threshold period (30 days).
2015-03-18 10:08:28,511 INFO      logstash-2015.03.07 is within the threshold period (30 days).
2015-03-18 10:08:28,511 INFO      logstash-2015.03.08 is within the threshold period (30 days).
2015-03-18 10:08:28,511 INFO      logstash-2015.03.09 is within the threshold period (30 days).
2015-03-18 10:08:28,512 INFO      logstash-2015.03.10 is within the threshold period (30 days).
2015-03-18 10:08:28,512 INFO      logstash-2015.03.11 is within the threshold period (30 days).
2015-03-18 10:08:28,512 INFO      logstash-2015.03.12 is within the threshold period (30 days).
2015-03-18 10:08:28,513 INFO      logstash-2015.03.13 is within the threshold period (30 days).
2015-03-18 10:08:28,513 INFO      logstash-2015.03.14 is within the threshold period (30 days).
2015-03-18 10:08:28,513 INFO      logstash-2015.03.15 is within the threshold period (30 days).
2015-03-18 10:08:28,514 INFO      logstash-2015.03.16 is within the threshold period (30 days).
2015-03-18 10:08:28,514 INFO      logstash-2015.03.17 is within the threshold period (30 days).
2015-03-18 10:08:28,514 INFO      logstash-2015.03.18 is within the threshold period (30 days).
2015-03-18 10:08:28,515 INFO      logstash-2015.03.19 is within the threshold period (30 days).
2015-03-18 10:08:28,515 INFO      CLOSE index operations completed.
2015-03-18 10:08:28,515 INFO      Done in 0:00:00.076108.
2015-03-18 10:08:28,533 INFO      logstash-2015.02.17 is within the threshold period (30 days).
2015-03-18 10:08:28,534 INFO      logstash-2015.02.18 is within the threshold period (30 days).
2015-03-18 10:08:28,534 INFO      logstash-2015.02.19 is within the threshold period (30 days).
2015-03-18 10:08:28,534 INFO      logstash-2015.02.20 is within the threshold period (30 days).
2015-03-18 10:08:28,535 INFO      logstash-2015.02.21 is within the threshold period (30 days).
2015-03-18 10:08:28,535 INFO      logstash-2015.02.22 is within the threshold period (30 days).
2015-03-18 10:08:28,535 INFO      logstash-2015.02.23 is within the threshold period (30 days).
2015-03-18 10:08:28,536 INFO      logstash-2015.02.24 is within the threshold period (30 days).
2015-03-18 10:08:28,536 INFO      logstash-2015.02.25 is within the threshold period (30 days).
2015-03-18 10:08:28,536 INFO      logstash-2015.02.26 is within the threshold period (30 days).
2015-03-18 10:08:28,537 INFO      logstash-2015.02.27 is within the threshold period (30 days).
2015-03-18 10:08:28,537 INFO      logstash-2015.02.28 is within the threshold period (30 days).
2015-03-18 10:08:28,537 INFO      logstash-2015.03.01 is within the threshold period (30 days).
2015-03-18 10:08:28,538 INFO      logstash-2015.03.02 is within the threshold period (30 days).
2015-03-18 10:08:28,538 INFO      logstash-2015.03.03 is within the threshold period (30 days).
2015-03-18 10:08:28,538 INFO      logstash-2015.03.04 is within the threshold period (30 days).
2015-03-18 10:08:28,538 INFO      logstash-2015.03.05 is within the threshold period (30 days).
2015-03-18 10:08:28,539 INFO      logstash-2015.03.06 is within the threshold period (30 days).
2015-03-18 10:08:28,539 INFO      logstash-2015.03.07 is within the threshold period (30 days).
2015-03-18 10:08:28,539 INFO      logstash-2015.03.08 is within the threshold period (30 days).
2015-03-18 10:08:28,540 INFO      logstash-2015.03.09 is within the threshold period (30 days).
2015-03-18 10:08:28,540 INFO      logstash-2015.03.10 is within the threshold period (30 days).
2015-03-18 10:08:28,540 INFO      logstash-2015.03.11 is within the threshold period (30 days).
2015-03-18 10:08:28,541 INFO      logstash-2015.03.12 is within the threshold period (30 days).
2015-03-18 10:08:28,541 INFO      logstash-2015.03.13 is within the threshold period (30 days).
2015-03-18 10:08:28,541 INFO      logstash-2015.03.14 is within the threshold period (30 days).
2015-03-18 10:08:28,541 INFO      logstash-2015.03.15 is within the threshold period (30 days).
2015-03-18 10:08:28,542 INFO      logstash-2015.03.16 is within the threshold period (30 days).
2015-03-18 10:08:28,542 INFO      logstash-2015.03.17 is within the threshold period (30 days).
2015-03-18 10:08:28,542 INFO      logstash-2015.03.18 is within the threshold period (30 days).
2015-03-18 10:08:28,543 INFO      logstash-2015.03.19 is within the threshold period (30 days).
2015-03-18 10:08:28,543 INFO      DELETE index operations completed.
2015-03-18 10:08:28,543 INFO      Done in 0:00:00.071379.
2015-03-18 10:08:28,578 INFO      Job starting...
2015-03-18 10:08:28,587 INFO      Beginning SNAPSHOT operations...
SUCCESS
2015-03-18 10:08:28,660 INFO      Job starting...
2015-03-18 10:08:28,661 INFO      Default timeout of 30 seconds is too low for command SNAPSHOT.  Overriding to 21,600 seconds (6 hours).
2015-03-18 10:08:28,667 INFO      Beginning SNAPSHOT operations...
2015-03-18 10:08:28,699 INFO      Attempting to create snapshot for index logstash-2015.02.17.
2015-03-18 10:08:28,777 INFO      Skipping index logstash-2015.02.17: Already optimized.
2015-03-18 10:08:28,777 INFO      Attempting to optimize index logstash-2015.02.18.
2015-03-18 10:08:29,107 INFO      Skipping index logstash-2015.02.18: Already optimized.
2015-03-18 10:08:29,108 INFO      Attempting to optimize index logstash-2015.02.19.
2015-03-18 10:08:29,432 INFO      Skipping index logstash-2015.02.19: Already optimized.
2015-03-18 10:08:29,433 INFO      Attempting to optimize index logstash-2015.02.20.
2015-03-18 10:08:29,789 INFO      Skipping index logstash-2015.02.20: Already optimized.
2015-03-18 10:08:29,790 INFO      Attempting to optimize index logstash-2015.02.21.
2015-03-18 10:08:30,108 INFO      Skipping index logstash-2015.02.21: Already optimized.
2015-03-18 10:08:30,108 INFO      Attempting to optimize index logstash-2015.02.22.
2015-03-18 10:08:30,418 INFO      Skipping index logstash-2015.02.22: Already optimized.
2015-03-18 10:08:30,418 INFO      Attempting to optimize index logstash-2015.02.23.
2015-03-18 10:08:30,694 INFO      Skipping index logstash-2015.02.23: Already optimized.
2015-03-18 10:08:30,694 INFO      Attempting to optimize index logstash-2015.02.24.
2015-03-18 10:08:30,953 INFO      Skipping index logstash-2015.02.24: Already optimized.
2015-03-18 10:08:30,953 INFO      Attempting to optimize index logstash-2015.02.25.
2015-03-18 10:08:31,039 INFO      Skipping index logstash-2015.02.25: Already optimized.
2015-03-18 10:08:31,040 INFO      Attempting to optimize index logstash-2015.02.26.
2015-03-18 10:08:31,185 INFO      Skipping index logstash-2015.02.26: Already optimized.
2015-03-18 10:08:31,186 INFO      Attempting to optimize index logstash-2015.02.27.
2015-03-18 10:08:31,338 INFO      logstash-2015.02.17 is within the threshold period (30 days).
2015-03-18 10:08:31,339 INFO      logstash-2015.02.18 is within the threshold period (30 days).
2015-03-18 10:08:31,339 INFO      logstash-2015.02.19 is within the threshold period (30 days).
2015-03-18 10:08:31,339 INFO      logstash-2015.02.20 is within the threshold period (30 days).
2015-03-18 10:08:31,340 INFO      logstash-2015.02.21 is within the threshold period (30 days).
2015-03-18 10:08:31,340 INFO      logstash-2015.02.22 is within the threshold period (30 days).
2015-03-18 10:08:31,341 INFO      logstash-2015.02.23 is within the threshold period (30 days).
2015-03-18 10:08:31,341 INFO      logstash-2015.02.24 is within the threshold period (30 days).
2015-03-18 10:08:31,341 INFO      logstash-2015.02.25 is within the threshold period (30 days).
2015-03-18 10:08:31,342 INFO      logstash-2015.02.26 is within the threshold period (30 days).
2015-03-18 10:08:31,342 INFO      logstash-2015.02.28 is within the threshold period (30 days).
2015-03-18 10:08:31,343 INFO      logstash-2015.02.27 is within the threshold period (30 days).
2015-03-18 10:08:31,343 INFO      logstash-2015.03.01 is within the threshold period (30 days).
2015-03-18 10:08:31,343 INFO      logstash-2015.03.02 is within the threshold period (30 days).
2015-03-18 10:08:31,344 INFO      DELETE SNAPSHOT index operations completed.
2015-03-18 10:08:31,344 INFO      Done in 0:00:02.789216.
2015-03-18 10:08:31,481 INFO      Skipping index logstash-2015.02.27: Already optimized.
2015-03-18 10:08:31,482 INFO      Attempting to optimize index logstash-2015.02.28.
2015-03-18 10:08:31,754 INFO      Skipping index logstash-2015.02.28: Already optimized.
2015-03-18 10:08:31,754 INFO      Attempting to optimize index logstash-2015.03.01.
2015-03-18 10:08:31,789 INFO      Skipping: A snapshot with name 'logstash-2015.02.17' already exists.
2015-03-18 10:08:31,790 INFO      Attempting to create snapshot for index logstash-2015.02.18.
2015-03-18 10:08:32,036 INFO      Skipping index logstash-2015.03.01: Already optimized.
2015-03-18 10:08:32,036 INFO      Attempting to optimize index logstash-2015.03.02.
2015-03-18 10:08:32,175 INFO      Skipping: A snapshot with name 'logstash-2015.02.18' already exists.
2015-03-18 10:08:32,176 INFO      Attempting to create snapshot for index logstash-2015.02.19.
2015-03-18 10:08:32,380 INFO      Skipping index logstash-2015.03.02: Already optimized.
2015-03-18 10:08:32,381 INFO      Attempting to optimize index logstash-2015.03.03.
2015-03-18 10:08:32,571 INFO      Skipping: A snapshot with name 'logstash-2015.02.19' already exists.
2015-03-18 10:08:32,571 INFO      Attempting to create snapshot for index logstash-2015.02.20.
2015-03-18 10:08:32,698 INFO      Skipping index logstash-2015.03.03: Already optimized.
2015-03-18 10:08:32,698 INFO      Attempting to optimize index logstash-2015.03.04.
2015-03-18 10:08:32,963 INFO      Skipping: A snapshot with name 'logstash-2015.02.20' already exists.
2015-03-18 10:08:32,963 INFO      Attempting to create snapshot for index logstash-2015.02.21.
2015-03-18 10:08:33,056 INFO      Skipping index logstash-2015.03.04: Already optimized.
2015-03-18 10:08:33,116 INFO      Attempting to optimize index logstash-2015.03.05.
2015-03-18 10:08:33,339 INFO      Skipping: A snapshot with name 'logstash-2015.02.21' already exists.
2015-03-18 10:08:33,340 INFO      Attempting to create snapshot for index logstash-2015.02.22.
2015-03-18 10:08:33,463 INFO      Skipping index logstash-2015.03.05: Already optimized.
2015-03-18 10:08:33,464 INFO      Attempting to optimize index logstash-2015.03.06.
2015-03-18 10:08:33,740 INFO      Skipping: A snapshot with name 'logstash-2015.02.22' already exists.
2015-03-18 10:08:33,741 INFO      Attempting to create snapshot for index logstash-2015.02.23.
2015-03-18 10:08:33,798 INFO      Skipping index logstash-2015.03.06: Already optimized.
2015-03-18 10:08:33,799 INFO      Attempting to optimize index logstash-2015.03.07.
2015-03-18 10:08:34,053 INFO      Skipping index logstash-2015.03.07: Already optimized.
2015-03-18 10:08:34,053 INFO      Attempting to optimize index logstash-2015.03.08.
2015-03-18 10:08:34,119 INFO      Skipping: A snapshot with name 'logstash-2015.02.23' already exists.
2015-03-18 10:08:34,120 INFO      Attempting to create snapshot for index logstash-2015.02.24.
2015-03-18 10:08:34,343 INFO      Skipping index logstash-2015.03.08: Already optimized.
2015-03-18 10:08:34,343 INFO      Attempting to optimize index logstash-2015.03.09.
2015-03-18 10:08:34,467 INFO      Skipping: A snapshot with name 'logstash-2015.02.24' already exists.
2015-03-18 10:08:34,468 INFO      Attempting to create snapshot for index logstash-2015.02.25.
2015-03-18 10:08:34,614 INFO      Skipping: A snapshot with name 'logstash-2015.02.25' already exists.
2015-03-18 10:08:34,615 INFO      Attempting to create snapshot for index logstash-2015.02.26.
2015-03-18 10:08:34,654 INFO      Skipping index logstash-2015.03.09: Already optimized.
2015-03-18 10:08:34,655 INFO      Attempting to optimize index logstash-2015.03.10.
2015-03-18 10:08:34,808 INFO      Skipping: A snapshot with name 'logstash-2015.02.26' already exists.
2015-03-18 10:08:34,808 INFO      Attempting to create snapshot for index logstash-2015.02.27.
2015-03-18 10:08:34,950 INFO      Skipping index logstash-2015.03.10: Already optimized.
2015-03-18 10:08:34,951 INFO      Attempting to optimize index logstash-2015.03.11.
2015-03-18 10:08:35,144 INFO      Skipping: A snapshot with name 'logstash-2015.02.27' already exists.
2015-03-18 10:08:35,144 INFO      Attempting to create snapshot for index logstash-2015.02.28.
2015-03-18 10:08:35,248 INFO      Skipping index logstash-2015.03.11: Already optimized.
2015-03-18 10:08:35,249 INFO      Attempting to optimize index logstash-2015.03.12.
2015-03-18 10:08:35,542 INFO      Skipping: A snapshot with name 'logstash-2015.02.28' already exists.
2015-03-18 10:08:35,543 INFO      Attempting to create snapshot for index logstash-2015.03.01.
2015-03-18 10:08:35,577 INFO      Skipping index logstash-2015.03.12: Already optimized.
2015-03-18 10:08:35,577 INFO      Attempting to optimize index logstash-2015.03.13.
2015-03-18 10:08:35,913 INFO      Skipping index logstash-2015.03.13: Already optimized.
2015-03-18 10:08:35,914 INFO      Attempting to optimize index logstash-2015.03.14.
2015-03-18 10:08:35,915 WARNING   Previous snapshot was unsuccessful.  Deleting snapshot logstash-2015.03.01 and trying again.
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/curator/curator.py", line 736, in <module>
    main()
  File "/usr/lib/python2.6/site-packages/curator/curator.py", line 731, in main
    arguments.func(client, **argdict)
  File "/usr/lib/python2.6/site-packages/curator/curator.py", line 585, in command_loop
    skipped = op(client, index_name, **kwargs)
  File "/usr/lib/python2.6/site-packages/curator/curator.py", line 409, in _create_snapshot
    _delete_snapshot(client, repository, snap_name)
TypeError: _delete_snapshot() takes exactly 2 arguments (3 given)
2015-03-18 10:08:36,204 INFO      Skipping index logstash-2015.03.14: Already optimized.
2015-03-18 10:08:36,204 INFO      Attempting to optimize index logstash-2015.03.15.
2015-03-18 10:08:36,483 INFO      Skipping index logstash-2015.03.15: Already optimized.
2015-03-18 10:08:36,484 INFO      Attempting to optimize index logstash-2015.03.16.
2015-03-18 10:08:36,785 INFO      Optimizing index logstash-2015.03.16 to 2 segments per shard.  Please wait...
Processed 0 node jobs.
Processed 1 global jobs.
tail: /usr/local/nagioslogserver/var/jobs.log: file truncated
Processed 0 node jobs.
Processed 0 global jobs.
tail: /usr/local/nagioslogserver/var/jobs.log: file truncated
Processed 0 node jobs.
Processed 0 global jobs.
tail: /usr/local/nagioslogserver/var/jobs.log: file truncated
Processed 0 node jobs.
Processed 0 global jobs.
tail: /usr/local/nagioslogserver/var/jobs.log: file truncated
2015-03-18 10:12:31,943 INFO      logstash-2015.03.16: Successfully optimized.
2015-03-18 10:12:31,944 INFO      logstash-2015.03.17 is within the threshold period (2 days).
2015-03-18 10:12:31,944 INFO      logstash-2015.03.18 is within the threshold period (2 days).
2015-03-18 10:12:31,944 INFO      logstash-2015.03.19 is within the threshold period (2 days).
2015-03-18 10:12:31,945 INFO      OPTIMIZE index operations completed.
2015-03-18 10:12:31,945 INFO      Done in 0:04:03.585242.

These are the contents of my backup mount point. Nothing is generating post March 2. I checked permissions, nothing has changed.

-rw-r--r-- 1 nobody users 117 Mar 18 00:58 index
drwxr-xr-x 57 nobody users 4096 Mar 2 18:15 indices
-rw-r--r-- 1 nobody users 61 Feb 18 11:25 metadata-logstash-2015.02.17
-rw-r--r-- 1 nobody users 61 Feb 19 09:59 metadata-logstash-2015.02.18
-rw-r--r-- 1 nobody users 61 Feb 23 14:22 metadata-logstash-2015.02.19
-rw-r--r-- 1 nobody users 61 Feb 23 14:28 metadata-logstash-2015.02.20
-rw-r--r-- 1 nobody users 61 Feb 23 14:39 metadata-logstash-2015.02.21
-rw-r--r-- 1 nobody users 61 Feb 23 14:44 metadata-logstash-2015.02.22
-rw-r--r-- 1 nobody users 61 Mar 2 10:55 metadata-logstash-2015.02.23
-rw-r--r-- 1 nobody users 61 Mar 2 11:00 metadata-logstash-2015.02.24
-rw-r--r-- 1 nobody users 61 Mar 2 11:01 metadata-logstash-2015.02.25
-rw-r--r-- 1 nobody users 61 Mar 2 11:01 metadata-logstash-2015.02.26
-rw-r--r-- 1 nobody users 61 Mar 2 18:05 metadata-logstash-2015.02.27
-rw-r--r-- 1 nobody users 61 Mar 2 11:09 metadata-logstash-2015.02.28
-rw-r--r-- 1 nobody users 61 Mar 2 18:11 metadata-logstash-2015.03.01
-rw-r--r-- 1 nobody users 61 Mar 2 18:15 metadata-logstash-2015.03.02
-rw-r--r-- 1 nobody users 190 Feb 18 11:29 snapshot-logstash-2015.02.17
-rw-r--r-- 1 nobody users 191 Feb 19 10:11 snapshot-logstash-2015.02.18
-rw-r--r-- 1 nobody users 190 Feb 23 14:28 snapshot-logstash-2015.02.19
-rw-r--r-- 1 nobody users 191 Feb 23 14:39 snapshot-logstash-2015.02.20
-rw-r--r-- 1 nobody users 190 Feb 23 14:44 snapshot-logstash-2015.02.21
-rw-r--r-- 1 nobody users 190 Feb 23 14:50 snapshot-logstash-2015.02.22
-rw-r--r-- 1 nobody users 190 Mar 2 11:00 snapshot-logstash-2015.02.23
-rw-r--r-- 1 nobody users 189 Mar 2 11:01 snapshot-logstash-2015.02.24
-rw-r--r-- 1 nobody users 188 Mar 2 11:01 snapshot-logstash-2015.02.25
-rw-r--r-- 1 nobody users 188 Mar 2 11:01 snapshot-logstash-2015.02.26
-rw-r--r-- 1 nobody users 190 Mar 2 18:11 snapshot-logstash-2015.02.27
-rw-r--r-- 1 nobody users 189 Mar 2 11:14 snapshot-logstash-2015.02.28
-rw-r--r-- 1 nobody users 309 Mar 2 18:15 snapshot-logstash-2015.03.01
-rw-r--r-- 1 nobody users 190 Mar 2 18:23 snapshot-logstash-2015.03.02
[root@blah nls_backup]#

[jolson]

Understood. Are you updated to version 1.3? If so, could I please get a screenshot of the "Administration -> Command Subsystem" page?

Jesse

[stecino]

Understood. Are you updated to version 1.3? If so, could I please get a screenshot of the "Administration -> Command Subsystem" page?

Jesse

please see attached

[jolson]

Please click the 'reset all jobs' button. This will set all jobs to their default values (and names). After this has been done, click 'Edit' next to 'backup_maintenance' and set the job to run 'Now'. This is a new feature that we implemented that makes it easier to run jobs. Let me know if that works for you!

[stecino]

Please click the 'reset all jobs' button. This will set all jobs to their default values (and names). After this has been done, click 'Edit' next to 'backup_maintenance' and set the job to run 'Now'. This is a new feature that we implemented that makes it easier to run jobs. Let me know if that works for you!

backup_maintenance Waiting SUCCESS 03/18/2015 11:10:12 1 day 03/19/2015 11:10:12 System Edit

nothing in the logs