【发布时间】:2019-04-02 11:23:50
【问题描述】:
你好我写了以下代码
val receivedStream: DStream[PubsubSparkMessage] =
PubsubSource.createStream(ssc, pubsubConfig, pubsubSubscriber)
@volatile var receivedMessages: List[PubsubSparkMessage] = List() //scalastyle:ignore
receivedStream.foreachRDD { rdd =>
if (!rdd.isEmpty()) {
receivedMessages = List(rdd.collect)
receivedMessages
}
}
我收到错误,因为类型不匹配; 我的问题是如何将 List[Array[PubsubSparkMessage]] 修改为 List[PubsubSparkMessage]
【问题讨论】:
-
发问题时请分享错误。
标签: scala apache-spark spark-streaming