Page 1 of 1

[Error] Logstash sending logs to Kafka

Posted: Tue Jan 02, 2018 5:47 pm
by carlos.mangini
I need to send logs from my logstash to kafka. After install via plugin "logstash-output-kafka", when I config de logstash.conf output, I'm getting this error:

./logstash --configtest -f /usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf
Unknown setting 'bootstrap_servers' for kafka {:level=>:error}


#999_outputs.conf

kafka {
topic_id => "logstash-kafka"
bootstrap_server => "200.185.10.10:2181"
}

I tried use others sintax for testing, like (acks, retries) but got the same error.
Could you guys give me some light?
My kafka server is not the same virtual machine. I don“t have problems with network or firewall.

Re: [Error] Logstash sending logs to Kafka

Posted: Wed Jan 03, 2018 9:13 am
by mcapra
If you're using a NLS version < 2.0.0, you'll want to reference the documentation for the Logstash 1.5 version of the plugin:
https://www.elastic.co/guide/en/logstas ... kafka.html

If you're using a NLS version > 2.0.0, you'll want to reference the documentation for the Logstash 2.4 version of the plugin:
https://www.elastic.co/guide/en/logstas ... kafka.html

I'm guessing your NLS version is < 2.0.0, meaning you'll want to use the broker_list directive instead of bootstrap_server. Let me know if I'm wrong.

Re: [Error] Logstash sending logs to Kafka

Posted: Wed Jan 03, 2018 11:41 am
by cdienger
Thanks for the info,@mcapra. Has this helped resolve your issue, @carlos.mangini?

Re: [Error] Logstash sending logs to Kafka

Posted: Thu Jan 04, 2018 5:30 pm
by carlos.mangini
Yes @cdienger! ;)

Thank you @mcapra!!
It was exactly what I needed, solving my problem. :D

Re: [Error] Logstash sending logs to Kafka

Posted: Thu Jan 04, 2018 5:37 pm
by kyang
Sounds good! Did you have any more questions or are we okay to lock this up?

Re: [Error] Logstash sending logs to Kafka

Posted: Mon Jan 08, 2018 4:38 pm
by carlos.mangini
No. Thank you guys!