Kafka shell 中的 Docker 错误 : kafka. zookeeper.ZooKeeperClientTimeoutException

Question

我正在尝试使用 docker 运行 kafka。

我启动了kafka服务。

docker-compose ps

     Name                        Command               State                         Ports                       

kafka-docker_kafka_1 start-kafka.sh 上 0.0.0.0:9092->9092/tcp
kafka-docker_zookeeper_1/bin/sh -c/usr/sbin/sshd ... 上 0.0.0.0:2181->2181/tcp, 22/tcp, 2888/TCP, 3888/TCP

docker-compose.yml

cat docker-compose.yml

version: '2'
services:
  zookeeper:
    image: wurstmeister/zookeeper
    ports:
      - "2181:2181"
  kafka:
    build: .
    ports:
      - "9092:9092"
    environment:
      KAFKA_ADVERTISED_HOST_NAME: kafka
      KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
      KAFKA_ZOOKEEPER_CONNECTION_TIMEOUT_MS: 36000
      KAFKA_ADVERTISED_PORT: 9092
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock

当我尝试通过进入 shell 内部来创建主题时，它抛出以下错误。

./start-kafka-shell.sh kafka zookeeper:2181

bash-4.4# $KAFKA_HOME/bin/kafka-topics.sh --create --topic sentiment --partitions 1 --zookeeper $ZK --replication-factor 1

[2019-02-12 08:07:59,097] WARN Session 0x0 for server zookeeper:2181, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
java.nio.channels.UnresolvedAddressException
    at sun.nio.ch.Net.checkAddress(Net.java:101)
    at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:622)
    at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:277)
    at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:287)
    at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1021)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1064)

尝试了 2 种可能性:

1. 在将主机名 :zookeeper(尽管我在 docker-compose.yml 中提到过相同)更改为 ip: 0.0.0.0 时出现超时异常

./start-kafka-shell.sh kafka 0.0.0.0:2181

bash-4.4# $KAFKA_HOME/bin/kafka-topics.sh --create --topic sentiment --partitions 1 --zookeeper $ZK --replication-factor 1

Exception in thread "main" kafka.zookeeper.ZooKeeperClientTimeoutException: Timed out waiting for connection while in state: CONNECTING
    at kafka.zookeeper.ZooKeeperClient.$anonfun$waitUntilConnected$3(ZooKeeperClient.scala:268)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
    at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:251)
    at kafka.zookeeper.ZooKeeperClient.waitUntilConnected(ZooKeeperClient.scala:264)
    at kafka.zookeeper.ZooKeeperClient.<init>(ZooKeeperClient.scala:97)
    at kafka.zk.KafkaZkClient$.apply(KafkaZkClient.scala:1694)
    at kafka.admin.TopicCommand$.main(TopicCommand.scala:57)
    at kafka.admin.TopicCommand.main(TopicCommand.scala)

1. 为了避免上述错误，我在docker-compose.yml中将超时参数从6000增加到36000 --> KAFKA_ZOOKEEPER_CONNECTION_TIMEOUT_MS: 36000

我遇到了同样的超时错误。

Answer 1

有很多预构建的 Kafka 镜像。很难说出您实际想要做什么，但您似乎正在重建图像？还是自己建？

虽然您绝对不需要将 zookeeper 地址作为参数来启动 Kafka

也就是说，0.0.0.0 不是要连接的真实地址。它通常用作绑定(bind)地址，意思是“允许到此服务器的所有连接”

然后 zookeeper 服务名称只能在 Docker 网络中解析，所以这可能解释了为什么你需要 --net，但这意味着你正在使用 docker run 用于某事，鉴于您使用的是 Compose

，这又不清楚

如果你想进入容器的shell，你应该只是使用docker-compose exec kafka bash，而Zookeeper已经是那个容器的环境变量了

类似的东西

docker-compose exec kafka bash -c '$KAFKA_HOME/bin/kafka-topics.sh --create --topic sentiment --partitions 1 --zookeeper $KAFKA_ZOOKEEPER_CONNECT --replication-factor 1'