docker - Docker:无法将数据从Logstash容器发送到Kafka容器

Question

我有2个docker容器，其中1个运行Logstash，另一个运行Zookeeper和Kafka。我正在尝试将数据从Logstash发送到Kafka，但似乎无法将数据传递到我在Kafka中的主题。

我可以登录Docker Kafka容器，并在终端上向我的主题生成一条消息，然后再使用它。

我正在使用输出kafka插件:

output {
    kafka {
        topic_id => "MyTopicName"
        broker_list => "kafkaIPAddress:9092"
    }
}

我从运行 docker inspect kafka2获得的ipAddress

当我运行 ./bin/logstash agent --config /etc/logstash/conf.d/01-input.conf时，出现此错误。

Settings: Default pipeline workers: 4
Unknown setting 'broker_list' for kafka {:level=>:error}
Pipeline aborted due to error {:exception=>#<LogStash::ConfigurationError: Something is wrong with your configuration.>, :backtrace=>["/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.3-java/lib/logstash/config/mixin.rb:134:in `config_init'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.3-java/lib/logstash/outputs/base.rb:63:in `initialize'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.3-java/lib/logstash/output_delegator.rb:74:in `register'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.3-java/lib/logstash/pipeline.rb:181:in `start_workers'", "org/jruby/RubyArray.java:1613:in `each'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.3-java/lib/logstash/pipeline.rb:181:in `start_workers'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.3-java/lib/logstash/pipeline.rb:136:in `run'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.3-java/lib/logstash/agent.rb:473:in `start_pipeline'"], :level=>:error}
stopping pipeline {:id=>"main"}

我通过运行以下返回OK的命令来检查文件的配置。

 ./bin/logstash agent --configtest --config /etc/logstash/conf.d/01-input.conf
Configuration OK

有没有人遇到过这个问题，难道我还没有打开kafka容器上的端口？如果是的话，如何在保持Kafka运行的同时做到这一点？

Answer 1

错误在这里broker_list => "kafkaIPAddress:9092"
尝试bootstrap_servers => "KafkaIPAddress:9092"如果您将容器放在不同的机器上，请将kafka映射到主机9092并使用主机地址:端口;如果在同一主机上，请使用内部Docker IP:port