使用模板训练时出错 https://github.com/apache/incubator-predictionio-template-text-classifier.git答案

【问题标题】：Getting Error while Training using template https://github.com/apache/incubator-predictionio-template-text-classifier.git使用模板训练时出错 https://github.com/apache/incubator-predictionio-template-text-classifier.git
【发布时间】：2017-10-13 15:01:49
【问题描述】：

我是 PredictionIo 的新手。我开始测试一些模板。当我使用文本分类并且我做pio train 我有以下异常

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.sql.SQLContext$implicits$.rddToDataFrameHolder(Lorg/apache/spark/rdd/RDD;Lscala/reflect/api/TypeTags$TypeTag;)Lorg/apache/spark/sql/DataFrameHolder;
at org.example.textclassification.LRAlgorithm.train(LRAlgorithm.scala:37)
at org.example.textclassification.LRAlgorithm.train(LRAlgorithm.scala:19)
at org.apache.predictionio.controller.P2LAlgorithm.trainBase(P2LAlgorithm.scala:49)
at org.apache.predictionio.controller.Engine$$anonfun$18.apply(Engine.scala:690)
at org.apache.predictionio.controller.Engine$$anonfun$18.apply(Engine.scala:690)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.immutable.List.foreach(List.scala:381)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.immutable.List.map(List.scala:285)
at org.apache.predictionio.controller.Engine$.train(Engine.scala:690)
at org.apache.predictionio.controller.Engine.train(Engine.scala:176)
at org.apache.predictionio.workflow.CoreWorkflow$.runTrain(CoreWorkflow.scala:67)
at org.apache.predictionio.workflow.CreateWorkflow$.main(CreateWorkflow.scala:251)
at org.apache.predictionio.workflow.CreateWorkflow.main(CreateWorkflow.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:743)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:187)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:212)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

我的环境 PredictionIO：版本0.11 火花：版本 2.1.1 弹性搜索：5.3.2 模板：https://github.com/apache/incubator-predictionio/

【问题讨论】：

标签： apache-spark-sql apache-spark-mllib predictionio

【解决方案1】：

您必须在 build.sbt 中提及特定的 spark 版本，如果这不能解决问题。然后请提供模板 Github 链接并提及您在模板中所做的任何其他更改。

【讨论】：