spark配置参数 - ooj88s

spark配置参数

~/.bashrc

export SPARK_HOME=/usr/local/spark

export PATH=$PATH:$SPARK_HOME/bin

/usr/local/spark/conf/log4j.properties

/usr/local/spark/conf/spark-env.sh

export SPARK_MASTER_IP=master

export SPARK_WORKER_CORES=XX

export SPARK_WORKER_MEMORY=XXXm

export SPARK_WORKER_INSTANCES=XX

/usr/local/spark/conf/slaves

 spark standalone默认端口7077

管理ui端口8080

posted on 2017-10-31 15:12  ooj88s  阅读(133)  评论(0)  编辑  收藏  举报