【问题标题】:Databricks Connect: Unable to run scala program in databricks cluster from IntelliJDatabricks Connect:无法在 IntelliJ 的 databricks 集群中运行 scala 程序
【发布时间】:2022-07-25 17:08:08
【问题描述】:

遵循this docs 中提到的步骤。 databricks-connect test 命令工作正常。但是,当我从 Intellij 启动测试 scala 程序时,我看到以下错误:

Exception in thread "main" java.lang.NoSuchMethodError: com.databricks.spark.util.MetricDefinitions$.EVENT_INITIAL_CONFIG_LOG()Lcom/databricks/spark/util/MetricDefinition;
    at com.databricks.spark.util.InitialConfigLogging$.recordInitialConfigs(InitialConfigLogging.scala:47)
    at org.apache.spark.sql.internal.SQLConf.recordSessionInitialConfs(SQLConf.scala:4166)
    at org.apache.spark.sql.SparkSession.<init>(SparkSession.scala:150)
    at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:1033)
    at com.srikanth.Demo$.main(Demo.scala:13)
    at com.srikanth.Demo.main(Demo.scala)

环境详情:

python - 3.8
java - 1.8
databricks-connect - 9.1

【问题讨论】:

    标签: intellij-idea databricks databricks-connect


    【解决方案1】:

    你能解决这个问题吗?我也有同样的问题

    【讨论】:

      猜你喜欢
      • 1970-01-01
      • 2019-10-16
      • 1970-01-01
      • 2021-09-26
      • 2021-06-14
      • 2022-01-24
      • 1970-01-01
      • 1970-01-01
      • 2019-11-24
      相关资源
      最近更新 更多