unable to start Logstash service on nagios log server!

[Adeel]

On nagios log server, we are unable to start logstash service and getting following error messages! Please help us in this regard.

-----------------------------------------------------------------------------------------------------------------------------

Code: Select all

[root@logtest2 ~]# [b]service logstash status[/b]
> Logstash Daemon dead but pid file exists
> [root@logtest2 ~]# [b]service logstash start[/b]
> Starting Logstash Daemon: WARNING: Default JAVA_OPTS will be overridden by
> the JAVA_OPTS defined in the environment. Environment JAVA_OPTS are
> -Djava.io.tmpdir=/usr/local/nagioslogserver/tmp
> [  OK  ]
> [root@logtest2 ~]# Oct 21, 2016 9:28:52 AM
> org.elasticsearch.plugins.PluginsService <init>
> INFO: [Isaiah Bradley] loaded [], sites []
> Oct 21, 2016 9:28:53 AM org.elasticsearch.common.network.NetworkUtils
> <clinit>
> WARNING: failed to resolve local host, fallback to loopback
> java.net.UnknownHostException: logtest2: logtest2: unknown error
>          at java.net.InetAddress.getLocalHost(Unknown Source)
>          at org.elasticsearch.common.network.NetworkUtils.<clinit>
> (NetworkUtils.java:55)
>          at
> org.elasticsearch.transport.netty.NettyTransport.createClientBootstrap
> (NettyTransport.java:329)
>          at org.elasticsearch.transport.netty.NettyTransport.doStart
> (NettyTransport.java:224)
>          at
> org.elasticsearch.common.component.AbstractLifecycleComponent.start
> (AbstractLifecycleComponent.java:85)
>          at org.elasticsearch.transport.TransportService.doStart
> (TransportService.java:153)
>          at
> org.elasticsearch.common.component.AbstractLifecycleComponent.start
> (AbstractLifecycleComponent.java:85)
>          at org.elasticsearch.client.transport.TransportClient.<init>
> (TransportClient.java:189)
>          at org.elasticsearch.client.transport.TransportClient.<init>
> (TransportClient.java:123)
>          at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>          at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown
> Source)
>          at sun.reflect.DelegatingConstructorAccessorImpl.newInstance
> (Unknown Source)
>          at java.lang.reflect.Constructor.newInstance(Unknown Source)
>          at org.jruby.javasupport.JavaConstructor.newInstanceDirect
> (JavaConstructor.java:268)
>          at org.jruby.java.invokers.ConstructorInvoker.call
> (ConstructorInvoker.java:83)
>          at org.jruby.java.invokers.ConstructorInvoker.call
> (ConstructorInvoker.java:174)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:336)
>          at org.jruby.runtime.callsite.CachingCallSite.callBlock
> (CachingCallSite.java:179)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:183)
>          at org.jruby.java.proxies.ConcreteJavaProxy$InitializeMethod.call
> (ConcreteJavaProxy.java:56)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:336)
>          at org.jruby.runtime.callsite.CachingCallSite.callBlock
> (CachingCallSite.java:179)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:183)
>          at org.jruby.RubyClass.newInstance(RubyClass.java:856)
>          at org.jruby.RubyClass$INVOKER$i$newInstance.call(RubyClass$INVOKER
> $i$newInstance.gen)
>          at org.jruby.internal.runtime.methods.JavaMethod
> $JavaMethodZeroOrOneOrNBlock.call(JavaMethod.java:301)
>          at org.jruby.java.proxies.ConcreteJavaProxy$NewMethod.call
> (ConcreteJavaProxy.java:155)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:326)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:170)
>          at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)
>          at org.jruby.ast.LocalAsgnNode.interpret(LocalAsgnNode.java:123)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
>          at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD
> (ASTInterpreter.java:74)
>          at org.jruby.internal.runtime.methods.InterpretedMethod.call
> (InterpretedMethod.java:182)
>          at org.jruby.internal.runtime.methods.DefaultMethod.call
> (DefaultMethod.java:203)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:326)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:170)
>          at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)
>          at org.jruby.ast.InstAsgnNode.interpret(InstAsgnNode.java:95)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
>          at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD
> (ASTInterpreter.java:74)
>          at org.jruby.internal.runtime.methods.InterpretedMethod.call
> (InterpretedMethod.java:139)
>          at org.jruby.internal.runtime.methods.DefaultMethod.call
> (DefaultMethod.java:187)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:306)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:136)
>          at org.jruby.ast.VCallNode.interpret(VCallNode.java:88)
>          at org.jruby.ast.InstAsgnNode.interpret(InstAsgnNode.java:95)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
>          at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD
> (ASTInterpreter.java:74)
>          at org.jruby.internal.runtime.methods.InterpretedMethod.call
> (InterpretedMethod.java:204)
>          at org.jruby.internal.runtime.methods.DefaultMethod.call
> (DefaultMethod.java:211)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:336)
>          at org.jruby.runtime.callsite.CachingCallSite.callBlock
> (CachingCallSite.java:179)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:183)
>          at org.jruby.RubyClass.newInstance(RubyClass.java:856)
>          at org.jruby.RubyClass$INVOKER$i$newInstance.call(RubyClass$INVOKER
> $i$newInstance.gen)
>          at org.jruby.internal.runtime.methods.JavaMethod
> $JavaMethodZeroOrOneOrNBlock.call(JavaMethod.java:301)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:326)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:170)
>          at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
>          at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK
> (ASTInterpreter.java:112)
>          at org.jruby.runtime.Interpreted19Block.evalBlockBody
> (Interpreted19Block.java:206)
>          at org.jruby.runtime.Interpreted19Block.yield
> (Interpreted19Block.java:157)
>          at org.jruby.runtime.Block.yield(Block.java:142)
>          at org.jruby.RubyArray.collect(RubyArray.java:2399)
>          at org.jruby.RubyArray.map19(RubyArray.java:2412)
>          at org.jruby.RubyArray$INVOKER$i$0$0$map19.call(RubyArray$INVOKER$i
> $0$0$map19.gen)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:316)
>          at org.jruby.runtime.callsite.CachingCallSite.callBlock
> (CachingCallSite.java:145)
>          at org.jruby.runtime.callsite.CachingCallSite.callIter
> (CachingCallSite.java:154)
>          at org.jruby.ast.CallNoArgBlockNode.interpret
> (CallNoArgBlockNode.java:64)
>          at org.jruby.ast.InstAsgnNode.interpret(InstAsgnNode.java:95)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.ast.IfNode.interpret(IfNode.java:118)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
>          at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD
> (ASTInterpreter.java:74)
>          at org.jruby.internal.runtime.methods.InterpretedMethod.call
> (InterpretedMethod.java:112)
>          at org.jruby.internal.runtime.methods.DefaultMethod.call
> (DefaultMethod.java:169)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:286)
>          at org.jruby.runtime.callsite.CachingCallSite.callBlock
> (CachingCallSite.java:81)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:85)
>          at org.jruby.RubySymbol$1.yieldInner(RubySymbol.java:461)
>          at org.jruby.RubySymbol$1.yield(RubySymbol.java:481)
>          at org.jruby.runtime.Block.yield(Block.java:142)
>          at org.jruby.RubyArray.eachCommon(RubyArray.java:1606)
>          at org.jruby.RubyArray.each(RubyArray.java:1613)
>          at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i
> $0$0$each.gen)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:316)
>          at org.jruby.runtime.callsite.CachingCallSite.callBlock
> (CachingCallSite.java:145)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:149)
>          at org.jruby.ast.CallNoArgBlockPassNode.interpret
> (CallNoArgBlockPassNode.java:53)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
>          at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD
> (ASTInterpreter.java:74)
>          at org.jruby.internal.runtime.methods.InterpretedMethod.call
> (InterpretedMethod.java:139)
>          at org.jruby.internal.runtime.methods.DefaultMethod.call
> (DefaultMethod.java:187)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:306)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:136)
>          at org.jruby.ast.VCallNode.interpret(VCallNode.java:88)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
>          at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD
> (ASTInterpreter.java:74)
>          at org.jruby.internal.runtime.methods.InterpretedMethod.call
> (InterpretedMethod.java:139)
>          at org.jruby.internal.runtime.methods.DefaultMethod.call
> (DefaultMethod.java:187)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:306)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:136)
>          at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
>          at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)
>          at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)
>          at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96)
>          at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD
> (ASTInterpreter.java:74)
>          at org.jruby.internal.runtime.methods.InterpretedMethod.call
> (InterpretedMethod.java:139)
>          at org.jruby.internal.runtime.methods.DefaultMethod.call
> (DefaultMethod.java:187)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:306)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:136)
>          at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)
>          at org.jruby.ast.ReturnNode.interpret(ReturnNode.java:92)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
>          at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK
> (ASTInterpreter.java:112)
>          at org.jruby.runtime.Interpreted19Block.evalBlockBody
> (Interpreted19Block.java:206)
>          at org.jruby.runtime.Interpreted19Block.yield
> (Interpreted19Block.java:194)
>          at org.jruby.runtime.Interpreted19Block.call
> (Interpreted19Block.java:125)
>          at org.jruby.runtime.Block.call(Block.java:101)
>          at org.jruby.RubyProc.call(RubyProc.java:290)
>          at org.jruby.RubyProc.call19(RubyProc.java:271)
>          at org.jruby.RubyProc$INVOKER$i$0$0$call19.call(RubyProc$INVOKER$i
> $0$0$call19.gen)
>          at org.jruby.internal.runtime.methods.DynamicMethod.call
> (DynamicMethod.java:202)
>          at org.jruby.internal.runtime.methods.DynamicMethod.call
> (DynamicMethod.java:198)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:306)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:136)
>          at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK
> (ASTInterpreter.java:112)
>          at org.jruby.runtime.Interpreted19Block.evalBlockBody
> (Interpreted19Block.java:206)
>          at org.jruby.runtime.Interpreted19Block.yield
> (Interpreted19Block.java:194)
>          at org.jruby.runtime.Interpreted19Block.call
> (Interpreted19Block.java:125)
>          at org.jruby.runtime.Block.call(Block.java:101)
>          at org.jruby.RubyProc.call(RubyProc.java:290)
>          at org.jruby.RubyProc.call19(RubyProc.java:271)
>          at org.jruby.RubyProc$INVOKER$i$0$0$call19.call(RubyProc$INVOKER$i
> $0$0$call19.gen)
>          at org.jruby.internal.runtime.methods.DynamicMethod.call
> (DynamicMethod.java:202)
>          at org.jruby.internal.runtime.methods.DynamicMethod.call
> (DynamicMethod.java:198)
>          at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall
> (CachingCallSite.java:306)
>          at org.jruby.runtime.callsite.CachingCallSite.call
> (CachingCallSite.java:136)
>          at org.jruby.ast.CallSpecialArgNode.interpret
> (CallSpecialArgNode.java:65)
>          at org.jruby.ast.DAsgnNode.interpret(DAsgnNode.java:110)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
>          at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)
>          at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)
>          at org.jruby.ast.BeginNode.interpret(BeginNode.java:83)
>          at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
>          at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK
> (ASTInterpreter.java:112)
>          at org.jruby.runtime.Interpreted19Block.evalBlockBody
> (Interpreted19Block.java:206)
>          at org.jruby.runtime.Interpreted19Block.yield
> (Interpreted19Block.java:194)
>          at org.jruby.runtime.Interpreted19Block.call
> (Interpreted19Block.java:125)
>          at org.jruby.runtime.Block.call(Block.java:101)
>          at org.jruby.RubyProc.call(RubyProc.java:290)
>          at org.jruby.RubyProc.call(RubyProc.java:228)
>          at org.jruby.internal.runtime.RubyRunnable.run
> (RubyRunnable.java:99)
>          at java.lang.Thread.run(Unknown Source)
> Caused by: java.net.UnknownHostException: logtest2: unknown error
>          at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
>          at java.net.InetAddress$2.lookupAllHostAddr(Unknown Source)
>          at java.net.InetAddress.getAddressesFromNameService(Unknown Source)
>          ... 170 more
>
> Oct 21, 2016 9:28:53 AM org.elasticsearch.plugins.PluginsService <init>
> INFO: [Terror] loaded [], sites []
> Oct 21, 2016 9:28:53 AM org.elasticsearch.plugins.PluginsService <init>
> INFO: [Baron Von Blitzschlag] loaded [], sites []
> Oct 21, 2016 9:28:53 AM org.elasticsearch.plugins.PluginsService <init>
> INFO: [Ancient One] loaded [], sites []
> Oct 21, 2016 9:28:53 AM org.elasticsearch.plugins.PluginsService <init>
> INFO: [Tempo] loaded [], sites []

[avandemore]

Can you post /etc/hosts? Has this worked previously?

[Adeel]

root@logtest2 etc]# more /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.18.40 logtest2-192-168-18-40
172.18.50.32 logtest2
172.12.0.37 logtest2-172-12-0-37
172.11.0.18 ipoib-virt-admin-172-11-0-18
[root@logtest2 etc]#

[mcapra]

Can you share the full output of the following commands:

Code: Select all

grep '' /usr/local/nagioslogserver/logstash/etc/conf.d/*
ping localhost -c 1

[Adeel]

Code: Select all

[root@logtest2 ~]# [b]grep '' /usr/local/nagioslogserver/logstash/etc/conf.d/*[/b]
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:# 
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:# Logstash Configuration File
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:# Dynamically created by Nagios Log Server
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:# DO NOT EDIT THIS FILE. IT WILL BE OVERWRITTEN.
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:# Created Fri, 14 Oct 2016 15:35:27 +0500
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:# Global inputs
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:# Local inputs
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/000_inputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:# 
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:# Logstash Configuration File
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:# Dynamically created by Nagios Log Server
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:# DO NOT EDIT THIS FILE. IT WILL BE OVERWRITTEN.
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:# Created Fri, 14 Oct 2016 15:35:27 +0500
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:# Global filters
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:# Local filters
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/500_filters.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:# 
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:# Logstash Configuration File
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:# Dynamically created by Nagios Log Server
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:# DO NOT EDIT THIS FILE. IT WILL BE OVERWRITTEN.
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:# Created Fri, 14 Oct 2016 15:35:27 +0500
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:# Required output for Nagios Log Server
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:output {
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:    elasticsearch {
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:        cluster => '30569a07-93bc-41b0-b22c-24c6f644fe0f'
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:        host => 'localhost'
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:        document_type => '%{type}'
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:        node_name => ''
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:        protocol => 'transport'
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:        workers => 4
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:    }
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:}
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:# Global outputs
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:# Local outputs
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:#
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:
/usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf:

Code: Select all

[root@logtest2 ~]#[b] ping localhost -c 1[/b]
PING localhost (127.0.0.1) 56(84) bytes of data.
64 bytes from localhost (127.0.0.1): icmp_seq=1 ttl=64 time=0.010 ms

--- localhost ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.010/0.010/0.010/0.000 ms
[root@logtest2 ~]#

[mcapra]

Was this Nagios Log Server instance installed on a clean, minimal CentOS or RHEL machine? I notice your logstash configurations lack the default filters/inputs which is concerning.

There is a known issue within Java7 that might be causing this. I would also suggest taking the output of the following:

Code: Select all

hostname -f 

And, if it's not localhost, adding it to the /etc/hosts file like so:

Code: Select all

127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 <hostname -f output>