【问题标题】:Unable to Build and Compile Toree无法构建和编译 Toree
【发布时间】:2016-11-22 01:04:44
【问题描述】:

从 master 构建时,在 toree 中运行 make devmake releasemake jupyter 时出现错误。

我的机器是 Ubuntu 16.04

root@ubuntu-2gb-sgp1-01:/home/incubator-toree# uname -r
4.4.0-47-generic

在 toree root 中运行 make release 时,我得到了

root@ubuntu-2gb-sgp1-01:/home/incubator-toree# make release
APACHE_SPARK_VERSION=2.0.0 VERSION=0.2.0.dev1-incubating IS_SNAPSHOT=true sbt toree/assembly
Unrecognized VM option 'MaxPermSize=1024M'
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.
Makefile:110: recipe for target 'target/scala-2.11/toree-assembly-0.2.0.dev1-incubating-SNAPSHOT.jar' failed
make: *** [target/scala-2.11/toree-assembly-0.2.0.dev1-incubating-SNAPSHOT.jar] Error 1
root@ubuntu-2gb-sgp1-01:/home/incubator-toree#

make jupyter

root@ubuntu-2gb-sgp1-01:/home/incubator-toree# make jupyter
APACHE_SPARK_VERSION=2.0.0 VERSION=0.2.0.dev1-incubating IS_SNAPSHOT=true sbt toree/assembly
Unrecognized VM option 'MaxPermSize=1024M'
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.
Makefile:110: recipe for target 'target/scala-2.11/toree-assembly-0.2.0.dev1-incubating-SNAPSHOT.jar' failed
make: *** [target/scala-2.11/toree-assembly-0.2.0.dev1-incubating-SNAPSHOT.jar] Error 1

我通过apt-get install default-jdk安装java

root@ubuntu-2gb-sgp1-01:/home/incubator-toree# java -version
openjdk version "9-internal"
OpenJDK Runtime Environment (build 9-internal+0-2016-04-14-195246.buildd.src)
OpenJDK 64-Bit Server VM (build 9-internal+0-2016-04-14-195246.buildd.src, mixed mode)
root@ubuntu-2gb-sgp1-01:/home/incubator-toree#

make release

root@ubuntu-2gb-sgp1-01:/home/incubator-toree# make release
APACHE_SPARK_VERSION=2.0.0 VERSION=0.2.0.dev1-incubating IS_SNAPSHOT=true sbt toree/assembly
Unrecognized VM option 'MaxPermSize=1024M'
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.
Makefile:110: recipe for target 'target/scala-2.11/toree-assembly-0.2.0.dev1-incubating-SNAPSHOT.jar' failed
make: *** [target/scala-2.11/toree-assembly-0.2.0.dev1-incubating-SNAPSHOT.jar] Error 1
root@ubuntu-2gb-sgp1-01:/home/incubator-toree#

我已经安装了 docker

root@ubuntu-2gb-sgp1-01:/home/incubator-toree# docker -v
Docker version 1.12.3, build 6b644ec

【问题讨论】:

  • 您是否尝试过为此使用 Oracle JDK?
  • 嗨 Viktor,我最终设法让它工作了。必须编译成一个包并使用 pip 安装
  • 好消息,恭喜!

标签: java ubuntu apache-spark jupyter-notebook apache-toree


【解决方案1】:

您不需要构建和编译 Toree,因为它已经提供了一个构建包。

Toree 的开发快照位于https://dist.apache.org/repos/dist/dev/incubator/toree。要使用这些软件包之一进行安装,您可以使用以下内容:

pip install <PIP_RELEASE_URL>

jupyter toree install

其中 PIP_RELEASE_URL 是 pip 包之一。例如:

pip install https://dist.apache.org/repos/dist/dev/incubator/toree/0.2.0/snapshots/dev1/toree-pip/toree-0.2.0.dev1.tar.gz
jupyter toree install --spark_home=$SPARK_HOME

【讨论】:

    猜你喜欢
    • 1970-01-01
    • 2019-04-01
    • 2019-02-24
    • 2017-12-03
    • 2014-12-20
    • 1970-01-01
    • 2020-05-02
    • 2021-05-25
    • 1970-01-01
    相关资源
    最近更新 更多