Page 1 of 1

Status Red. please help!

Posted: Mon May 21, 2018 5:34 am
by danniiffxi
Hi All

I am fairly new to the world of Nagios Log Server. I have an issue with our Cluster where i have 20 unassigned shards. I have followed the guide on https://support.nagios.com/kb/print-90.html but I am unable to delete the logstash files (When i do they reappear)

I then run:
curl -XPOST 'localhost:9200/_cluster/reroute' -d '{ "commands" : [ { "allocate" : { "index" : "logstash-2018.05.20", "shard" : 1, "node" : "d52d205d-a044-40f6-968e-3b4fe31c952e", "allow_primary" : true } } ] }'

and this is returned:
{"error":"ElasticsearchIllegalArgumentException[[allocate] allocation of [logstash-2018.05.20][1] on node [d52d205d-a044-40f6-968e-3b4fe31c952e][KsQqb3VsQIS7Z2-pxqm1YA][w*********02][inet[/1**.***.***.**3:9300]]{max_local_storage_nodes=1} is not allowed, reason: [YES(shard is not allocated to same node or host)][YES(node passes include/exclude/require filters)][YES(shard is primary)][YES(below primary recovery limit of [4])][YES(allocation disabling is ignored)][YES(allocation disabling is ignored)][YES(no allocation awareness enabled)][YES(total shard limit disabled: [-1] <= 0)][YES(primary shard can be allocated anywhere)][NO(after allocation more than allowed [95.0%] used disk on node, free: [8.59176811070615%])][YES(shard not primary or relocation disabled)]]","status":400}[

Can anyone help with the solution please :)

Re: Status Red. please help!

Posted: Mon May 21, 2018 9:48 am
by mcapra
Simply put:

Code: Select all

[NO(after allocation more than allowed [95.0%] used disk on node, free: [8.59176811070615%])]
Your disk is probably close to capacity. I would suggest adding more space, or removing some old data to free up space. See this documentation (specifically the "Maintenance Settings" section) to automate the removal of old data as a regular maintenance task:
https://assets.nagios.com/downloads/nag ... enance.pdf

Re: Status Red. please help!

Posted: Mon May 21, 2018 11:06 am
by cdienger
Thanks for the assist, @mcapra! @danniiffxi , let us know if you have any questions about the doc that was provided or if you need any further help.

Re: Status Red. please help!

Posted: Fri Jun 29, 2018 9:52 am
by danniiffxi
Thank you guys :) sorry for the late reply lol. I managed to get it sorted. I didn't clear enough of the old logs

Re: Status Red. please help!

Posted: Fri Jun 29, 2018 10:31 am
by npolovenko
@danniiffxi, Thanks for the update. I will be locking this thread as resolved.