Page 1 of 1

Maintenance of Elastic Search Nodes

Posted: Wed Aug 26, 2015 8:34 pm
by stecino
Hello,

I want to remove NLS nodes out of the cluster, in order to perform maintenance (disk expansion)


I have Step-by-step guide for ElasticSearch rolling restart, and whether it would apply to NLS

Check cluster setting: curl -u XXX:XXX -XGET "http://localhost:9200/_cluster/settings?pretty=true"

Disable shard allocation:
curl -u XXX:XXX -XPUT "http://localhost:9200/_cluster/settings" -d'
{
"transient" : {
"cluster.routing.allocation.enable" : "none"
}
}'

shutdown the node
curl -u xxx:xxx-XPOST "http://localhost:9200/_cluster/nodes/_local/_shutdown"
Wait for the connection clear out.
netstat -on | grep 9200|wc
netstat -on | grep 9300|wc

upgrade/server maintenance or .....

restart elasticsearch: service elasticsearch start

Enable shard allocation:
curl -u xxx:xxx -XPUT "http://localhost:9200/_cluster/settings" -d'
{
"transient" : {
"cluster.routing.allocation.enable" : "all"
}
}'
Wait for cluster status to green. Repeat step 1 to 6 for all other nodes.

* The speed of shard reallocation is related to following:

cluster.routing.allocation.cluster_concurrent_rebalance default is 2
indices.recovery.max_bytes_per_sec defaults to 40mb

Re: Maintenance of Elastic Search Nodes

Posted: Thu Aug 27, 2015 11:11 am
by jolson
The answer is yes - this applies to Nagios Log Server as well, and is very close to our own maintenance document: https://assets.nagios.com/downloads/nag ... Server.pdf

You could use either procedure without trouble. Thanks!

Re: Maintenance of Elastic Search Nodes

Posted: Thu Aug 27, 2015 1:48 pm
by stecino
jolson wrote:The answer is yes - this applies to Nagios Log Server as well, and is very close to our own maintenance document: https://assets.nagios.com/downloads/nag ... Server.pdf

You could use either procedure without trouble. Thanks!
Perfect!! Thanks

Re: Maintenance of Elastic Search Nodes

Posted: Thu Aug 27, 2015 1:50 pm
by hsmith
stecino wrote:
jolson wrote:The answer is yes - this applies to Nagios Log Server as well, and is very close to our own maintenance document: https://assets.nagios.com/downloads/nag ... Server.pdf

You could use either procedure without trouble. Thanks!
Perfect!! Thanks
Are we all right to mark this one as resolved and lock it up?