diff options
| author | tedyu <yuzhihong@gmail.com> | 2015-03-04 11:00:52 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-03-04 11:00:52 +0000 |
| commit | 8d3e2414d430e1a0eb209eacba2cf739f3eab0c5 (patch) | |
| tree | 8b6ccc21e922607adf609dd2de7d0eee3f5d8aa5 /docs | |
| parent | 76e20a0a03cf2c02db35e00271924efb070eaaa5 (diff) | |
| download | spark-8d3e2414d430e1a0eb209eacba2cf739f3eab0c5.tar.gz spark-8d3e2414d430e1a0eb209eacba2cf739f3eab0c5.tar.bz2 spark-8d3e2414d430e1a0eb209eacba2cf739f3eab0c5.zip | |
SPARK-6085 Increase default value for memory overhead
Author: tedyu <yuzhihong@gmail.com>
Closes #4836 from tedyu/master and squashes the following commits:
d65b495 [tedyu] SPARK-6085 Increase default value for memory overhead
1fdd4df [tedyu] SPARK-6085 Increase default value for memory overhead
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/running-on-mesos.md | 2 | ||||
| -rw-r--r-- | docs/running-on-yarn.md | 2 |
2 files changed, 2 insertions, 2 deletions
diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md index db1173a06b..e509e4bf37 100644 --- a/docs/running-on-mesos.md +++ b/docs/running-on-mesos.md @@ -225,7 +225,7 @@ See the [configuration page](configuration.html) for information on Spark config </tr> <tr> <td><code>spark.mesos.executor.memoryOverhead</code></td> - <td>executor memory * 0.07, with minimum of 384</td> + <td>executor memory * 0.10, with minimum of 384</td> <td> This value is an additive for <code>spark.executor.memory</code>, specified in MiB, which is used to calculate the total Mesos task memory. A value of <code>384</code> diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 2b93eef6c2..68b1aeb8eb 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -113,7 +113,7 @@ Most of the configs are the same for Spark on YARN as for other deployment modes </tr> <tr> <td><code>spark.yarn.executor.memoryOverhead</code></td> - <td>executorMemory * 0.07, with minimum of 384 </td> + <td>executorMemory * 0.10, with minimum of 384 </td> <td> The amount of off heap memory (in megabytes) to be allocated per executor. This is memory that accounts for things like VM overheads, interned strings, other native overheads, etc. This tends to grow with the executor size (typically 6-10%). </td> |