Page 1 of 1

about shard num

Posted: Thu Jun 18, 2020 8:21 pm
by winsonlee
we extend cluster to 8 node, but index shards in "Cluster status" still show 5, it's correct?

Re: about shard num

Posted: Fri Jun 19, 2020 7:28 am
by scottwilkerson
Yes, each index always has 5 primary shards and 5 backup shards (a replica). Each of these shards are distributed between the 8 nodes in your cluster (making sure each primary and backup shard are always on different nodes), and all shards participate in returning search results.

Re: about shard num

Posted: Fri Jun 19, 2020 11:45 pm
by winsonlee
scottwilkerson wrote:Yes, each index always has 5 primary shards and 5 backup shards (a replica). Each of these shards are distributed between the 8 nodes in your cluster (making sure each primary and backup shard are always on different nodes), and all shards participate in returning search results.
our index has 300GB ~ 350GB per day, 5 shards it's mean each shard size about 60GB, is no issue about performance ?

Re: about shard num

Posted: Mon Jun 22, 2020 1:08 pm
by cdienger
No, this shouldn't be a problem.

Re: about shard num

Posted: Mon Jun 22, 2020 10:45 pm
by winsonlee
cdienger wrote:No, this shouldn't be a problem.
if i want to increase shards number to 10, how to do that?

Re: about shard num

Posted: Tue Jun 23, 2020 11:41 am
by cdienger
It can be set in /usr/local/nagioslogserver/elasticsearch/config/elasticsearch.yml but please note that this file can be overwritten during upgrades and we recommend the default value of 5 shards per index.

Re: about shard num

Posted: Tue Jun 23, 2020 7:58 pm
by winsonlee
cdienger wrote:It can be set in /usr/local/nagioslogserver/elasticsearch/config/elasticsearch.yml but please note that this file can be overwritten during upgrades and we recommend the default value of 5 shards per index.
ok, thanks for you help and notice. let me test is different at 5 to 10 shards.

Re: about shard num

Posted: Wed Jun 24, 2020 1:42 pm
by cdienger
Sounds good. Let us know your results.

Re: about shard num

Posted: Sun Jun 28, 2020 9:28 pm
by winsonlee
i change shards to 11,it's work, the query speed has been improved.

Re: about shard num

Posted: Mon Jun 29, 2020 9:36 am
by cdienger
Thanks for the update!