【发布时间】:2019-11-19 19:19:41
【问题描述】:
我正在尝试使用 sbt package 构建 jar。
build.sbt:
name := "Simple Project"
version := "0.1"
scalaVersion := "2.11.8"
val sparkVersion = "2.3.2"
val connectorVersion = "2.3.0"
val cassandraVersion = "3.11"
libraryDependencies ++= Seq(
"org.apache.spark" %% "spark-core" % sparkVersion % "provided",
"org.apache.spark" %% "spark-sql" % sparkVersion % "provided",
"org.apache.spark" %% "spark-hive" % sparkVersion % "provided",
"org.scalaj" %% "scalaj-http" % "2.4.2",
"com.datastax.spark" %% "spark-cassandra-connector" % connectorVersion
)
sbt package 运行成功,但没有将 spark-cassandra-connector 和 scalaj-http 添加到最终创建的 jar 中。
我需要添加什么吗?
【问题讨论】:
标签: scala apache-spark sbt spark-cassandra-connector