diff options
author | Jongyoul Lee <jongyoul@gmail.com> | 2015-03-18 20:54:22 -0400 |
---|---|---|
committer | Sean Owen <sowen@cloudera.com> | 2015-03-18 20:54:22 -0400 |
commit | 3db13874250ded267d7455898e4048a70a47fdcd (patch) | |
tree | 7eca7502213a5bc81afdf15fdddbe2da195a79e3 /docs | |
parent | a95ee242b0a9644c912fc54ed68b4301c9558bc9 (diff) | |
download | spark-3db13874250ded267d7455898e4048a70a47fdcd.tar.gz spark-3db13874250ded267d7455898e4048a70a47fdcd.tar.bz2 spark-3db13874250ded267d7455898e4048a70a47fdcd.zip |
SPARK-6085 Part. 2 Increase default value for memory overhead
- fixed a description of spark.mesos.executor.memoryOverhead from 7% to 10%
- This is a second part of SPARK-6085
Author: Jongyoul Lee <jongyoul@gmail.com>
Closes #5065 from jongyoul/SPARK-6085-1 and squashes the following commits:
c5af84c [Jongyoul Lee] SPARK-6085 Part. 2 Increase default value for memory overhead - Changed "MiB" to "MB"
dbac1c0 [Jongyoul Lee] SPARK-6085 Part. 2 Increase default value for memory overhead - fixed a description of spark.mesos.executor.memoryOverhead from 7% to 10%
Diffstat (limited to 'docs')
-rw-r--r-- | docs/running-on-mesos.md | 6 |
1 files changed, 3 insertions, 3 deletions
diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md index 59a3e9d25b..6a9d304501 100644 --- a/docs/running-on-mesos.md +++ b/docs/running-on-mesos.md @@ -224,11 +224,11 @@ See the [configuration page](configuration.html) for information on Spark config <td><code>spark.mesos.executor.memoryOverhead</code></td> <td>executor memory * 0.10, with minimum of 384</td> <td> - This value is an additive for <code>spark.executor.memory</code>, specified in MiB, + This value is an additive for <code>spark.executor.memory</code>, specified in MB, which is used to calculate the total Mesos task memory. A value of <code>384</code> - implies a 384MiB overhead. Additionally, there is a hard-coded 7% minimum + implies a 384MB overhead. Additionally, there is a hard-coded 10% minimum overhead. The final overhead will be the larger of either - `spark.mesos.executor.memoryOverhead` or 7% of `spark.executor.memory`. + `spark.mesos.executor.memoryOverhead` or 10% of `spark.executor.memory`. </td> </tr> </table> |