Spring Boot 和 Kafka：发送 SSL 关闭消息失败答案

【问题标题】：Spring Boot and Kafka: Failed to send SSL Close messageSpring Boot 和 Kafka：发送 SSL 关闭消息失败
【发布时间】：2018-07-21 16:43:57
【问题描述】：

我正在将 Spring Boot 与 Kafka 一起使用，并希望收听有关现有和工作代理和主题的消息。

application.yml配置如下：

spring:
  kafka:
    topic:
        boot: my_topic
    bootstrap-servers: hostname:9092
    properties:
      security.protocol: SSL
    consumer:
      auto-offset-reset: earliest
      group-id: my_group
      enable-auto-commit: false
      fetch-max-wait: 500
      max-poll-records: 1

抛出以下错误：

2018-02-11 11:36:34.302  WARN 1676 --- [ntainer#0-0-C-1] o.a.k.common.network.SslTransportLayer   : Failed to send SSL Close message 

java.io.IOException: An existing connection was forcibly closed by the remote host
    at sun.nio.ch.SocketDispatcher.write0(Native Method) ~[na:1.8.0_20]
    at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:51) ~[na:1.8.0_20]
    at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) ~[na:1.8.0_20]
    at sun.nio.ch.IOUtil.write(IOUtil.java:65) ~[na:1.8.0_20]
    at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:470) ~[na:1.8.0_20]
    at org.apache.kafka.common.network.SslTransportLayer.flush(SslTransportLayer.java:195) ~[kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.common.network.SslTransportLayer.close(SslTransportLayer.java:163) ~[kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.common.utils.Utils.closeAll(Utils.java:690) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.common.network.KafkaChannel.close(KafkaChannel.java:47) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.common.network.Selector.close(Selector.java:487) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:368) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.common.network.Selector.poll(Selector.java:291) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:260) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:232) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:209) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.awaitMetadataUpdate(ConsumerNetworkClient.java:148) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.awaitMetadataUpdate(ConsumerNetworkClient.java:136) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:197) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:248) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1013) [kafka-clients-0.10.1.1.jar:na]
    at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:979) [kafka-clients-0.10.1.1.jar:na]
    at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.run(KafkaMessageListenerContainer.java:556) [spring-kafka-1.1.7.RELEASE.jar:na]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_20]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_20]
    at java.lang.Thread.run(Thread.java:745) [na:1.8.0_20]

无法更改 kafka broker 和 producer 的配置。 Spring Boot 中的客户端 kafka 配置中是否缺少任何可以添加来解决此问题的内容？

谢谢

【问题讨论】：

>An existing connection was forcibly closed by the remote host - 我建议你看看服务器日志看看他在抱怨什么。
来自服务器日志：org.apache.kafka.common.network.InvalidReceiveException: 无效接收（大小 = 369296128 大于 104857600）

标签： spring-boot apache-kafka kafka-consumer-api spring-kafka

【解决方案1】：

您的代理似乎未配置 SSL；如果我在客户端上设置 SSL，我会得到同样的错误；我的经纪人不使用 SSL...

[2018-02-12 11:04:45,700] WARN 来自 /127.0.0.1 的意外错误；关闭连接（org.apache.kafka.common.network.Selector） org.apache.kafka.common.network.InvalidReceiveException: 无效接收（大小 = 369296128 大于 104857600）

【讨论】：