【发布时间】:2022-07-25 17:08:08
【问题描述】:
遵循this docs 中提到的步骤。 databricks-connect test 命令工作正常。但是,当我从 Intellij 启动测试 scala 程序时,我看到以下错误:
Exception in thread "main" java.lang.NoSuchMethodError: com.databricks.spark.util.MetricDefinitions$.EVENT_INITIAL_CONFIG_LOG()Lcom/databricks/spark/util/MetricDefinition;
at com.databricks.spark.util.InitialConfigLogging$.recordInitialConfigs(InitialConfigLogging.scala:47)
at org.apache.spark.sql.internal.SQLConf.recordSessionInitialConfs(SQLConf.scala:4166)
at org.apache.spark.sql.SparkSession.<init>(SparkSession.scala:150)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:1033)
at com.srikanth.Demo$.main(Demo.scala:13)
at com.srikanth.Demo.main(Demo.scala)
环境详情:
python - 3.8
java - 1.8
databricks-connect - 9.1
【问题讨论】:
标签: intellij-idea databricks databricks-connect