[Error] Logstash sending logs to Kafka

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
Locked
carlos.mangini
Posts: 12
Joined: Thu Jun 01, 2017 9:33 am

[Error] Logstash sending logs to Kafka

Post by carlos.mangini »

I need to send logs from my logstash to kafka. After install via plugin "logstash-output-kafka", when I config de logstash.conf output, I'm getting this error:

./logstash --configtest -f /usr/local/nagioslogserver/logstash/etc/conf.d/999_outputs.conf
Unknown setting 'bootstrap_servers' for kafka {:level=>:error}


#999_outputs.conf

kafka {
topic_id => "logstash-kafka"
bootstrap_server => "200.185.10.10:2181"
}

I tried use others sintax for testing, like (acks, retries) but got the same error.
Could you guys give me some light?
My kafka server is not the same virtual machine. I don´t have problems with network or firewall.
User avatar
mcapra
Posts: 3739
Joined: Thu May 05, 2016 3:54 pm

Re: [Error] Logstash sending logs to Kafka

Post by mcapra »

If you're using a NLS version < 2.0.0, you'll want to reference the documentation for the Logstash 1.5 version of the plugin:
https://www.elastic.co/guide/en/logstas ... kafka.html

If you're using a NLS version > 2.0.0, you'll want to reference the documentation for the Logstash 2.4 version of the plugin:
https://www.elastic.co/guide/en/logstas ... kafka.html

I'm guessing your NLS version is < 2.0.0, meaning you'll want to use the broker_list directive instead of bootstrap_server. Let me know if I'm wrong.
Former Nagios employee
https://www.mcapra.com/
User avatar
cdienger
Support Tech
Posts: 5045
Joined: Tue Feb 07, 2017 11:26 am

Re: [Error] Logstash sending logs to Kafka

Post by cdienger »

Thanks for the info,@mcapra. Has this helped resolve your issue, @carlos.mangini?
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
carlos.mangini
Posts: 12
Joined: Thu Jun 01, 2017 9:33 am

Re: [Error] Logstash sending logs to Kafka

Post by carlos.mangini »

Yes @cdienger! ;)

Thank you @mcapra!!
It was exactly what I needed, solving my problem. :D
kyang

Re: [Error] Logstash sending logs to Kafka

Post by kyang »

Sounds good! Did you have any more questions or are we okay to lock this up?
carlos.mangini
Posts: 12
Joined: Thu Jun 01, 2017 9:33 am

Re: [Error] Logstash sending logs to Kafka

Post by carlos.mangini »

No. Thank you guys!
Locked