1、启动hadoop

sbin/start-dfs.sh

2、启动spark

sbin/start-all.sh

3、jps

Idea打jar包提交到Spark集群运行

4、上传jar包

Idea打jar包提交到Spark集群运行

5、提交任务

bin/spark-submit --class com.pro.second.KafkaDirectorDemo3 SparkStreaming-1.0.0-jar-with-dependencies.jar --master spark://hadoop101:7077

相关文章: