【问题标题】:Dstream Spark StreamingDstream 火花流
【发布时间】:2019-04-02 11:23:50
【问题描述】:

你好我写了以下代码

val receivedStream: DStream[PubsubSparkMessage] =
      PubsubSource.createStream(ssc, pubsubConfig, pubsubSubscriber)
    @volatile var receivedMessages: List[PubsubSparkMessage] = List() //scalastyle:ignore
    receivedStream.foreachRDD { rdd =>
      if (!rdd.isEmpty()) {
        receivedMessages = List(rdd.collect)
        receivedMessages
      }
    }

我收到错误,因为类型不匹配; 我的问题是如何将 List[Array[PubsubSparkMessage]] 修改为 List[PubsubSparkMessage]

【问题讨论】:

  • 发问题时请分享错误。

标签: scala apache-spark spark-streaming


【解决方案1】:

类似:

val list : List[Array[PubsubSparkMessage]] = List()

val result = list.flatMap(x => x)

【讨论】:

    猜你喜欢
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2017-04-27
    • 2016-02-07
    • 2015-05-15
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多