logstash daemon stopping

[benhank]

the bad news is that my trial expired and I have to wait to the PO gets to you guys in a week or so. so we have to table this until then.

[lgroschen]

I'll leave this open. Post here when you are ready.

[benhank]

bad news:
'

Code: Select all

	Logstash Daemon	Logstash Daemon dead but pid file exists	2015-01-23 07:25:55	2015-01-23 07:35:55

[scottwilkerson]

benhank, anything in your logstash or elasticsearch logs indicating any errors?

Code: Select all

/var/log/logstash/logstash.log
/var/log/elasticsearch/<really long id>.log

[scottwilkerson]

Also you could be hitting this bug
http://support.nagios.com/forum/viewtop ... 63#p122363

[benhank]

gimme a bit to get the info.

[benhank]

here is the elasticsearch log, it will be a while b4 i can open the logstash log. 21gigs...

[tmcdonald]

You could just tail the last 100 or so lines if it's that big, though a file that big tells me there is probably a lot in there to see anyway.

[benhank]

sorry guys I was out of action for a while here is my latest log file.

[scottwilkerson]

Ben,

You are hitting a "Too many open files" error

Follow instruction here for each of your servers:
http://support.nagios.com/forum/viewtop ... 83#p122363

and then restart logstash (on each server)

Code: Select all

service logstash restart