diff options
| author | Holden Karau <holden@us.ibm.com> | 2015-11-17 15:51:03 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-11-17 15:51:03 -0800 |
| commit | 52c734b589277267be07e245c959199db92aa189 (patch) | |
| tree | c385a63c02e9fb9b59e69568a072df1a44cd60d5 /yarn/src | |
| parent | 3720b1480c7d050ca20f98d65762224ae5639607 (diff) | |
| download | spark-52c734b589277267be07e245c959199db92aa189.tar.gz spark-52c734b589277267be07e245c959199db92aa189.tar.bz2 spark-52c734b589277267be07e245c959199db92aa189.zip | |
[SPARK-11771][YARN][TRIVIAL] maximum memory in yarn is controlled by two params have both in error msg
When we exceed the max memory tell users to increase both params instead of just the one.
Author: Holden Karau <holden@us.ibm.com>
Closes #9758 from holdenk/SPARK-11771-maximum-memory-in-yarn-is-controlled-by-two-params-have-both-in-error-msg.
Diffstat (limited to 'yarn/src')
| -rw-r--r-- | yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala b/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala index a3f33d8018..ba799884f5 100644 --- a/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala +++ b/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala @@ -258,7 +258,8 @@ private[spark] class Client( if (executorMem > maxMem) { throw new IllegalArgumentException(s"Required executor memory (${args.executorMemory}" + s"+$executorMemoryOverhead MB) is above the max threshold ($maxMem MB) of this cluster! " + - "Please increase the value of 'yarn.scheduler.maximum-allocation-mb'.") + "Please check the values of 'yarn.scheduler.maximum-allocation-mb' and/or " + + "'yarn.nodemanager.resource.memory-mb'.") } val amMem = args.amMemory + amMemoryOverhead if (amMem > maxMem) { |