Home » Categories » Products » Nagios Log Server » Troubleshooting » Common Problems

Nagios Log Server - Logstash process dying

Problem Description

You experience problems with the Logstash process dying. On the console of your server you observe the following::

INFO: [6a7ce4ea-e1b9-47a1-af18-1c4d47243d20] failed to get node info for [#transport#-1][sa585][inet[localhost/127.0.0.1:9300]], disconnecting...
java.lang.OutOfMemoryError: GC overhead limit exceeded

 

Even after adding more memory to your server you continue to receive these errors.

 

 

Logstash Tuning

There are some parameters in the /etc/init.d/logstash file that can resolve this issues.

In a terminal session on your Log Server instance(s) execute the following command to open the file in vi:

vi /etc/init.d/logstash

 

When using the vi editor, to make changes press i on the keyboard first to enter insert mode. Press Esc to exit insert mode.

 

Update the file by changing the following lines:

LS_HEAP_SIZE="1000m"
LS_OPEN_FILES=65535

 

When you have finished making the changes, save the changes in vi by typing:

:wq

and press Enter.

 

You need to restart the service using one of the commands below:

RHEL 6 | CentOS 6 | Ubuntu 14

service logstash restart

 

RHEL 7 | CentOS 7 | Debian | Ubuntu 16/18

systemctl daemon-reload
systemctl restart logstash.service

 

After making these changes the logstash process should no longer die.

 

 

Final Thoughts

For any support related questions please visit the Nagios Support Forums at:

http://support.nagios.com/forum/

0 (0)
Article Rating (No Votes)
Rate this article
  • Icon PDFExport to PDF
  • Icon MS-WordExport to MS Word
Attachments Attachments
There are no attachments for this article.
Related Articles RSS Feed
Nagios Log Server - Understanding and Troubleshooting Red Cluster Health
Viewed 829 times since Mon, Apr 6, 2015
Nagios Log Server - Logs Not Searchable or Not Coming In
Viewed 1356 times since Tue, Jan 27, 2015
Nagios Log Server - Resetting nagiosadmin Password
Viewed 1168 times since Tue, Aug 9, 2016
Nagios Log Server - rsyslog and JSON Formatted Log Files
Viewed 420 times since Thu, Mar 2, 2017
Nagios Log Server - Troubleshooting Commands
Viewed 488 times since Mon, Feb 11, 2019
Nagios Log Server - Logstash not running after upgrade to 2.0
Viewed 403 times since Tue, Nov 14, 2017
Web Browser Reports 330 Error Content Encoding
Viewed 525 times since Tue, Mar 7, 2017
Nagios Log Server - Troubleshooting SELinux and rsyslog
Viewed 858 times since Wed, Mar 30, 2016
Nagios Log Server - Newline Character Added When Adding A Filter To A Search
Viewed 411 times since Wed, Apr 27, 2016
Nagios Log Server - Waiting For Database Startup
Viewed 608 times since Wed, Oct 12, 2016