【问题标题】:Spring-XD Error while processing: KafkaMessage, MessageDispatchingException: Dispatcher has no subscribers处理时出现 Spring-XD 错误:KafkaMessage,MessageDispatchingException:调度程序没有订阅者
【发布时间】:2015-05-25 03:44:46
【问题描述】:

我正在使用 Spring-XD 从 kafka 读取主题,使用 spark-streaming-processor 过滤数据并将数据下沉到 spark 中。

我用来部署流的命令是:

stream create spark-streaming-word-count --definition "kafka --zkconnect=localhost:2181 --topic=log-stream | java-word-count | log" --deploy

我得到的错误是:

2015-05-23 11:36:16,190 1.1.1.RELEASE ERROR dispatcher-1 listener.LoggingErrorHandler - Error while processing: KafkaMessage [Message(magic = 0, attributes = 0, crc = 3699841462, key = java.nio.HeapByteBuffer[pos=0 lim=6 cap=437], payload = java.nio.HeapByteBuffer[pos=0 lim=427 cap=427]), KafkaMessageMetadata [offset=26353, nextOffset=26354, Partition[topic='log-stream', id=0]]
org.springframework.messaging.MessageDeliveryException: Dispatcher has no subscribers for channel 'admin:default,admin,singlenode,hsqldbServer:9393.spark-streaming-word-count.0'.; nested exception is org.springframework.integration.MessageDispatchingException: Dispatcher has no subscribers
    at org.springframework.integration.channel.AbstractSubscribableChannel.doSend(AbstractSubscribableChannel.java:81)
    at org.springframework.integration.channel.AbstractMessageChannel.send(AbstractMessageChannel.java:277)
    at org.springframework.integration.channel.AbstractMessageChannel.send(AbstractMessageChannel.java:239)
    at org.springframework.messaging.core.GenericMessagingTemplate.doSend(GenericMessagingTemplate.java:115)
    at org.springframework.messaging.core.GenericMessagingTemplate.doSend(GenericMessagingTemplate.java:45)
    at org.springframework.messaging.core.AbstractMessageSendingTemplate.send(AbstractMessageSendingTemplate.java:95)
    at org.springframework.integration.handler.AbstractMessageProducingHandler.sendOutput(AbstractMessageProducingHandler.java:248)
    at org.springframework.integration.handler.AbstractMessageProducingHandler.produceOutput(AbstractMessageProducingHandler.java:171)
    at org.springframework.integration.handler.AbstractMessageProducingHandler.sendOutputs(AbstractMessageProducingHandler.java:119)
    at org.springframework.integration.handler.AbstractReplyProducingMessageHandler.handleMessageInternal(AbstractReplyProducingMessageHandler.java:105)

请帮我解决这个问题

谢谢

【问题讨论】:

    标签: apache-kafka spark-streaming spring-xd


    【解决方案1】:

    什么是流部署状态? shell 命令stream list 将为您提供流部署状态。另外,请尝试runtime modules 查看正在运行的模块。看起来下游模块java-word-count 尚未部署。

    【讨论】:

      猜你喜欢
      • 2020-04-22
      • 2017-09-12
      • 2015-11-02
      • 2019-01-25
      • 2013-08-16
      • 2017-04-10
      • 2018-02-19
      • 1970-01-01
      • 2016-12-31
      相关资源
      最近更新 更多