【发布时间】：2021-04-23 23:38:16
【问题描述】：
我已经设法将 ksqldb 服务器部署在一个 ec2 实例上，使用 msk kafka 作为 kafka 服务器，使用 docker-compose 及其工作正常（能够使用 python KSQL API 客户端连接并访问主题和 msk 中的流。
version: '2'
services:
ksqldb-server:
image: confluentinc/ksqldb-server:0.14.0
hostname: ksqldb-server
container_name: ksqldb-server
ports:
- "8088:8088"
environment:
KSQL_LISTENERS: http://0.0.0.0:8088
KSQL_BOOTSTRAP_SERVERS: b-1.ksql-kafka-tesing.boqxnyhyk.c2.kafka.ap-south-1.amazonaws.com:9092,b-2.ksql-kafka-tesing.byuuttoqxnk.c2.kafka.ap-south-1.amazonaws.com:9092,b-3.ksql-kafka-tesing.boqxyytuytutnk.c2.kafka.ap-south-1.amazonaws.com:9092
KSQL_KSQL_LOGGING_PROCESSING_STREAM_AUTO_CREATE: "true"
KSQL_KSQL_LOGGING_PROCESSING_TOPIC_AUTO_CREATE: "true"
但是当我在 AWS FARGET 上部署下面这个 docker 镜像时，它具有正确的集群和任务定义，它会在 cloudwatch 日志上给出以下错误日志
2021-01-19T21:16:50.425+05:30 ssl.truststore.type = JKS
2021-01-19T21:16:50.425+05:30 (io.confluent.ksql.util.KsqlConfig:354)
2021-01-19T21:16:53.417+05:30 [2021-01-19 15:46:53,413] ERROR Failed to start KSQL (io.confluent.ksql.rest.server.KsqlServerMain:68)
2021-01-19T21:16:53.417+05:30 java.lang.RuntimeException: Failed to get Kafka cluster information
2021-01-19T21:16:53.417+05:30 at io.confluent.ksql.services.KafkaClusterUtil.getKafkaClusterId(KafkaClusterUtil.java:107)
2021-01-19T21:16:53.417+05:30 at io.confluent.ksql.rest.server.KsqlRestApplication.buildApplication(KsqlRestApplication.java:605)
2021-01-19T21:16:53.417+05:30 at io.confluent.ksql.rest.server.KsqlServerMain.createExecutable(KsqlServerMain.java:161)
2021-01-19T21:16:53.417+05:30 at io.confluent.ksql.rest.server.KsqlServerMain.main(KsqlServerMain.java:61)
2021-01-19T21:16:53.417+05:30 Caused by: org.apache.kafka.common.config.ConfigException: Missing required configuration "bootstrap.servers" which has no default value.
2021-01-19T21:16:53.417+05:30 at org.apache.kafka.common.config.ConfigDef.parseValue(ConfigDef.java:478)
2021-01-19T21:16:53.417+05:30 at org.apache.kafka.common.config.ConfigDef.parse(ConfigDef.java:468)
2021-01-19T21:16:53.417+05:30 at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:108)
2021-01-19T21:16:53.417+05:30 at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:142)
2021-01-19T21:16:53.417+05:30 at org.apache.kafka.clients.admin.AdminClientConfig.<init>(AdminClientConfig.java:233)
2021-01-19T21:16:53.417+05:30 at org.apache.kafka.clients.admin.Admin.create(Admin.java:74)
2021-01-19T21:16:53.417+05:30 at org.apache.kafka.streams.processor.internals.DefaultKafkaClientSupplier.getAdmin(DefaultKafkaClientSupplier.java:41)
2021-01-19T21:16:53.417+05:30 at io.confluent.ksql.services.ServiceContextFactory.lambda$create$1(ServiceContextFactory.java:58)
2021-01-19T21:16:53.417+05:30 at com.google.common.base.Suppliers$NonSerializableMemoizingSupplier.get(Suppliers.java:164)
2021-01-19T21:16:53.417+05:30 at io.confluent.ksql.services.DefaultServiceContext$MemoizedSupplier.get(DefaultServiceContext.java:176)
2021-01-19T21:16:53.417+05:30 at io.confluent.ksql.services.DefaultServiceContext.getAdminClient(DefaultServiceContext.java:116)
2021-01-19T21:16:53.417+05:30 at io.confluent.ksql.services.LazyServiceContext.getAdminClient(LazyServiceContext.java:33)
2021-01-19T21:16:53.417+05:30 at io.confluent.ksql.services.KafkaClusterUtil.getKafkaClusterId(KafkaClusterUtil.java:102)
我还在farget容器中启用了端口8083、8088、80，同时在容器中添加docker镜像。
无法找出为什么同一个 docker compose 映像没有在 farget 上运行但在 ec2 机器上运行而没有错误。
有人可以帮我吗？我对 ksql 和 aws farget 也完全陌生。提前致谢
PS：我已经按照这个教程在farget Deploy Docker Image on Farget using ECR and ECS上部署了一个docker镜像
【问题讨论】：
-
您能否编辑您的问题以详细说明您如何部署到 Fargate？
Missing required configuration "bootstrap.servers"听起来你在传递必要的配置时出错了，但如果不看看你是如何做到的，就很难说。 -
youtube.com/watch?v=JzsSjcyN3MI&t=610s 我按照本教程在 farget 上部署了一个 docker 映像，并相应地进行了配置@RobinMoffatt
-
您也可以在 docker-compose 文件中使用 KSQL_BOOTSTRAP_SERVERS，该文件在 ec2 机器上运行 @RobinMoffatt
标签： docker-compose amazon-ecs aws-fargate ksqldb aws-msk