Status Red. please help!

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
Locked
danniiffxi
Posts: 121
Joined: Tue Jan 30, 2018 3:29 am
Location: UK

Status Red. please help!

Post by danniiffxi »

Hi All

I am fairly new to the world of Nagios Log Server. I have an issue with our Cluster where i have 20 unassigned shards. I have followed the guide on https://support.nagios.com/kb/print-90.html but I am unable to delete the logstash files (When i do they reappear)

I then run:
curl -XPOST 'localhost:9200/_cluster/reroute' -d '{ "commands" : [ { "allocate" : { "index" : "logstash-2018.05.20", "shard" : 1, "node" : "d52d205d-a044-40f6-968e-3b4fe31c952e", "allow_primary" : true } } ] }'

and this is returned:
{"error":"ElasticsearchIllegalArgumentException[[allocate] allocation of [logstash-2018.05.20][1] on node [d52d205d-a044-40f6-968e-3b4fe31c952e][KsQqb3VsQIS7Z2-pxqm1YA][w*********02][inet[/1**.***.***.**3:9300]]{max_local_storage_nodes=1} is not allowed, reason: [YES(shard is not allocated to same node or host)][YES(node passes include/exclude/require filters)][YES(shard is primary)][YES(below primary recovery limit of [4])][YES(allocation disabling is ignored)][YES(allocation disabling is ignored)][YES(no allocation awareness enabled)][YES(total shard limit disabled: [-1] <= 0)][YES(primary shard can be allocated anywhere)][NO(after allocation more than allowed [95.0%] used disk on node, free: [8.59176811070615%])][YES(shard not primary or relocation disabled)]]","status":400}[

Can anyone help with the solution please :)
User avatar
mcapra
Posts: 3739
Joined: Thu May 05, 2016 3:54 pm

Re: Status Red. please help!

Post by mcapra »

Simply put:

Code: Select all

[NO(after allocation more than allowed [95.0%] used disk on node, free: [8.59176811070615%])]
Your disk is probably close to capacity. I would suggest adding more space, or removing some old data to free up space. See this documentation (specifically the "Maintenance Settings" section) to automate the removal of old data as a regular maintenance task:
https://assets.nagios.com/downloads/nag ... enance.pdf
Former Nagios employee
https://www.mcapra.com/
User avatar
cdienger
Support Tech
Posts: 5045
Joined: Tue Feb 07, 2017 11:26 am

Re: Status Red. please help!

Post by cdienger »

Thanks for the assist, @mcapra! @danniiffxi , let us know if you have any questions about the doc that was provided or if you need any further help.
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
danniiffxi
Posts: 121
Joined: Tue Jan 30, 2018 3:29 am
Location: UK

Re: Status Red. please help!

Post by danniiffxi »

Thank you guys :) sorry for the late reply lol. I managed to get it sorted. I didn't clear enough of the old logs
npolovenko
Support Tech
Posts: 3457
Joined: Mon May 15, 2017 5:00 pm

Re: Status Red. please help!

Post by npolovenko »

@danniiffxi, Thanks for the update. I will be locking this thread as resolved.
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
Locked