diff options
| author | Marcelo Vanzin <vanzin@cloudera.com> | 2015-10-06 10:17:12 -0700 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2015-10-06 10:17:12 -0700 |
| commit | 744f03e700b0e3a7c2a92e92edc79d2374c19023 (patch) | |
| tree | 0bac297ffb172752b90ff72f188e5741fc0e93d8 /core/src | |
| parent | 27ecfe61f07c8413a7b8b9fbdf36ed99cf05227d (diff) | |
| download | spark-744f03e700b0e3a7c2a92e92edc79d2374c19023.tar.gz spark-744f03e700b0e3a7c2a92e92edc79d2374c19023.tar.bz2 spark-744f03e700b0e3a7c2a92e92edc79d2374c19023.zip | |
[SPARK-10916] [YARN] Set perm gen size when launching containers on YARN.
This makes YARN containers behave like all other processes launched by
Spark, which launch with a default perm gen size of 256m unless
overridden by the user (or not needed by the vm).
Author: Marcelo Vanzin <vanzin@cloudera.com>
Closes #8970 from vanzin/SPARK-10916.
Diffstat (limited to 'core/src')
| -rw-r--r-- | core/src/main/scala/org/apache/spark/launcher/WorkerCommandBuilder.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/core/src/main/scala/org/apache/spark/launcher/WorkerCommandBuilder.scala b/core/src/main/scala/org/apache/spark/launcher/WorkerCommandBuilder.scala index 0c096656f9..a2add61617 100644 --- a/core/src/main/scala/org/apache/spark/launcher/WorkerCommandBuilder.scala +++ b/core/src/main/scala/org/apache/spark/launcher/WorkerCommandBuilder.scala @@ -40,7 +40,7 @@ private[spark] class WorkerCommandBuilder(sparkHome: String, memoryMb: Int, comm cmd.add(s"-Xms${memoryMb}M") cmd.add(s"-Xmx${memoryMb}M") command.javaOpts.foreach(cmd.add) - addPermGenSizeOpt(cmd) + CommandBuilderUtils.addPermGenSizeOpt(cmd) addOptionString(cmd, getenv("SPARK_JAVA_OPTS")) cmd } |