ElasticsearchSinkConnector 无法连接到 Elastic

Question

使用 kafka-lenses-dev 图像时，我在将 Kafka 连接到本地 Elasticsearch 7.1.1 实例时遇到了问题。如您所见，尽管实例已启动并正在运行并且可以将文档卷入其中，但连接被拒绝。连接器的 Elastic 版本是否存在问题或配置错误？

配置

connector.class=io.confluent.connect.elasticsearch.ElasticsearchSinkConnector
type.name=kafka-connect
key.converter.schemas.enable=false
topics=cc_data
name=elastic-sink
value.converter.schemas.enable=false
connection.url=http://localhost:9200
key.ignore=true

错误

org.apache.kafka.connect.errors.ConnectException: Couldn't start ElasticsearchSinkTask due to connection error:
    at io.confluent.connect.elasticsearch.jest.JestElasticsearchClient.<init>(JestElasticsearchClient.java:147)
    at io.confluent.connect.elasticsearch.jest.JestElasticsearchClient.<init>(JestElasticsearchClient.java:114)
    at io.confluent.connect.elasticsearch.ElasticsearchSinkTask.start(ElasticsearchSinkTask.java:120)
...
Caused by: io.searchbox.client.config.exception.CouldNotConnectException: Could not connect to http://localhost:9200
    at io.searchbox.client.http.JestHttpClient.execute(JestHttpClient.java:60)
    at io.confluent.connect.elasticsearch.jest.JestElasticsearchClient.getServerVersion(JestElasticsearchClient.java:168)
    at io.confluent.connect.elasticsearch.jest.JestElasticsearchClient.<init>(JestElasticsearchClient.java:145)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to localhost:9200 [localhost/127.0.0.1] failed: Connection refused (Connection refused)
...
Caused by: java.net.ConnectException: Connection refused (Connection refused)
...

Answer 1

您已将 Elasticsearch 指定为localhost:9200。除非 Elasticsearch 在与 Kafka Connect 相同的容器上运行，否则此主机名是错误的。您需要以可从运行 Kafka Connect 的位置访问的形式指定 Elasticsearch 的主机名。

作为示例，您可以查看如何基于this Docker Compose here 进行配置的示例。