Page 4 of 6

Re: logstash daemon stopping

Posted: Thu Jan 22, 2015 11:02 am
by benhank
the bad news is that my trial expired and I have to wait to the PO gets to you guys in a week or so. so we have to table this until then.

Re: logstash daemon stopping

Posted: Thu Jan 22, 2015 11:06 am
by lgroschen
I'll leave this open. Post here when you are ready.

Re: logstash daemon stopping

Posted: Fri Jan 23, 2015 11:08 am
by benhank
bad news:
'

Code: Select all

	Logstash Daemon	Logstash Daemon dead but pid file exists	2015-01-23 07:25:55	2015-01-23 07:35:55

Re: logstash daemon stopping

Posted: Fri Jan 23, 2015 11:46 am
by scottwilkerson
tmcdonald wrote:benhank, anything in your logstash or elasticsearch logs indicating any errors?

Code: Select all

/var/log/logstash/logstash.log
/var/log/elasticsearch/<really long id>.log

Re: logstash daemon stopping

Posted: Fri Jan 23, 2015 11:47 am
by scottwilkerson

Re: logstash daemon stopping

Posted: Fri Jan 23, 2015 1:40 pm
by benhank
gimme a bit to get the info.

Re: logstash daemon stopping

Posted: Fri Jan 23, 2015 2:06 pm
by benhank
here is the elasticsearch log, it will be a while b4 i can open the logstash log. 21gigs...

Re: logstash daemon stopping

Posted: Fri Jan 23, 2015 2:10 pm
by tmcdonald
You could just tail the last 100 or so lines if it's that big, though a file that big tells me there is probably a lot in there to see anyway.

Re: logstash daemon stopping

Posted: Wed Jan 28, 2015 12:08 pm
by benhank
sorry guys I was out of action for a while here is my latest log file.

Re: logstash daemon stopping

Posted: Wed Jan 28, 2015 1:53 pm
by scottwilkerson
Ben,

You are hitting a "Too many open files" error

Follow instruction here for each of your servers:
http://support.nagios.com/forum/viewtop ... 83#p122363

and then restart logstash (on each server)

Code: Select all

service logstash restart