【问题标题】:How to start kafka in multi-broker cluster mode with docker-compose?如何使用 docker-compose 在多代理集群模式下启动 kafka?
【发布时间】:2020-03-02 10:04:25
【问题描述】:

我有 docker-compose.yml 文件:

version: '3.7'
  services:
  zookeeper-1:
  image: confluentinc/cp-zookeeper:latest
  ports:
    - 22181:22181
  environment:
  ZOOKEEPER_SERVER_ID: 1
  ZOOKEEPER_CLIENT_PORT: 22181
  ZOOKEEPER_TICK_TIME: 2000
  ZOOKEEPER_INIT_LIMIT: 5
  ZOOKEEPER_SYNC_LIMIT: 2
  ZOOKEEPER_SERVERS: zookeeper-1:22888:23888;zookeeper-2:32888:33888;zookeeper-3:42888:43888
  networks:
  - zk_net


zookeeper-2:
image: confluentinc/cp-zookeeper:latest
ports:
  - 32181:32181
environment:
  ZOOKEEPER_SERVER_ID: 2
  ZOOKEEPER_CLIENT_PORT: 32181
  ZOOKEEPER_TICK_TIME: 2000
  ZOOKEEPER_INIT_LIMIT: 5
  ZOOKEEPER_SYNC_LIMIT: 2
  ZOOKEEPER_SERVERS: zookeeper-1:22888:23888;zookeeper-2:32888:33888;zookeeper-3:42888:43888
networks:
  - zk_net

zookeeper-3:
image: confluentinc/cp-zookeeper:latest
ports:
  - 42181:42181
environment:
  ZOOKEEPER_SERVER_ID: 3
  ZOOKEEPER_CLIENT_PORT: 42181
  ZOOKEEPER_TICK_TIME: 2000
  ZOOKEEPER_INIT_LIMIT: 5
  ZOOKEEPER_SYNC_LIMIT: 2
  ZOOKEEPER_SERVERS: zookeeper-1:22888:23888;zookeeper-2:32888:33888;zookeeper-3:42888:43888
networks:
  - zk_net


kafka-1:
image: confluentinc/cp-kafka:latest
ports:
  - 19092:19092
depends_on:
  - zookeeper-1
  - zookeeper-2
  - zookeeper-3
environment:
  KAFKA_BROKER_ID: 1
  KAFKA_ZOOKEEPER_CONNECT: zookeeper-1:22181,zookeeper-2:32181,zookeeper-3:42181
  KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafka-1:19092
  KAFKA_SOCKET_REQUEST_MAX_BYTES: 500000000
networks:
  - zk_net

kafka-2:
image: confluentinc/cp-kafka:latest
ports:
  - 29092:29092
depends_on:
  - zookeeper-1
  - zookeeper-2
  - zookeeper-3
environment:
  KAFKA_BROKER_ID: 2
  KAFKA_ZOOKEEPER_CONNECT: zookeeper-1:22181,zookeeper-2:32181,zookeeper-3:42181
  KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafka-2:29092
  KAFKA_SOCKET_REQUEST_MAX_BYTES: 500000000
networks:
  - zk_net

kafka-3:
image: confluentinc/cp-kafka:latest
ports:
  - 39092:39092
depends_on:
  - zookeeper-1
  - zookeeper-2
  - zookeeper-3
environment:
  KAFKA_BROKER_ID: 3
  KAFKA_ZOOKEEPER_CONNECT: zookeeper-1:22181,zookeeper-2:32181,zookeeper-3:42181
  KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafka-3:39092
  KAFKA_SOCKET_REQUEST_MAX_BYTES: 500000000
networks:
  zk_net:
   driver: bridge

当我试图杀死 docker 中的 node-1 并从我的 Java 代码中获取节点数时,如下所示:

DescribeClusterResult describeClusterResult = adminClient.describeCluster(new DescribeClusterOptions()); List<Node> nodeList = new ArrayList<>(describeClusterResult.nodes().get(TIME_OUT, TimeUnit.MILLISECONDS));

节点数为空,因为节点 1 已关闭。但我认为如果节点 1 关闭,则节点 2 和节点 3 还活着,所以它必须工作,并返回 2 个活着的节点,但事实并非如此。

【问题讨论】:

    标签: java apache-kafka docker-compose


    【解决方案1】:

    如果有助于查看您使用哪些属性创建 AdminClient 以及您是否正在传递所有引导服务器。

    【讨论】:

      猜你喜欢
      • 1970-01-01
      • 2022-01-13
      • 2018-01-14
      • 2017-07-10
      • 1970-01-01
      • 2022-01-21
      • 2021-08-03
      • 1970-01-01
      • 1970-01-01
      相关资源
      最近更新 更多