diff options
| author | tedyu <yuzhihong@gmail.com> | 2015-03-04 11:00:52 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-03-04 11:00:52 +0000 |
| commit | 8d3e2414d430e1a0eb209eacba2cf739f3eab0c5 (patch) | |
| tree | 8b6ccc21e922607adf609dd2de7d0eee3f5d8aa5 /yarn | |
| parent | 76e20a0a03cf2c02db35e00271924efb070eaaa5 (diff) | |
| download | spark-8d3e2414d430e1a0eb209eacba2cf739f3eab0c5.tar.gz spark-8d3e2414d430e1a0eb209eacba2cf739f3eab0c5.tar.bz2 spark-8d3e2414d430e1a0eb209eacba2cf739f3eab0c5.zip | |
SPARK-6085 Increase default value for memory overhead
Author: tedyu <yuzhihong@gmail.com>
Closes #4836 from tedyu/master and squashes the following commits:
d65b495 [tedyu] SPARK-6085 Increase default value for memory overhead
1fdd4df [tedyu] SPARK-6085 Increase default value for memory overhead
Diffstat (limited to 'yarn')
| -rw-r--r-- | yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala b/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala index 146b2c0f1a..5881dc5ffa 100644 --- a/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala +++ b/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala @@ -86,10 +86,10 @@ class YarnSparkHadoopUtil extends SparkHadoopUtil { object YarnSparkHadoopUtil { // Additional memory overhead - // 7% was arrived at experimentally. In the interest of minimizing memory waste while covering + // 10% was arrived at experimentally. In the interest of minimizing memory waste while covering // the common cases. Memory overhead tends to grow with container size. - val MEMORY_OVERHEAD_FACTOR = 0.07 + val MEMORY_OVERHEAD_FACTOR = 0.10 val MEMORY_OVERHEAD_MIN = 384 val ANY_HOST = "*" |