java.lang.IllegalArgumentException: Required executor memory (1024), overhead (384 MB), and PySpark

 

 

 

yarn.app.mapreduce.am.resource.mb =4

java.lang.IllegalArgumentException: Required executor memory (1024), overhead (384 MB), and PySpark

yarn.nodemanager.resource.memory-mb=8

java.lang.IllegalArgumentException: Required executor memory (1024), overhead (384 MB), and PySpark

yarn.scheduler.maximum-allocation-mb=4g

java.lang.IllegalArgumentException: Required executor memory (1024), overhead (384 MB), and PySpark

 

java.lang.IllegalArgumentException: Required executor memory (1024), overhead (384 MB), and PySpark

 

sudo -u hdfs spark-shell

java.lang.IllegalArgumentException: Required executor memory (1024), overhead (384 MB), and PySpark

相关文章: