diff options
| author | Brenden Matthews <brenden@diddyinc.com> | 2014-10-03 12:58:04 -0700 |
|---|---|---|
| committer | Andrew Or <andrewor14@gmail.com> | 2014-10-03 12:58:17 -0700 |
| commit | 6f150978477830bbc14ba983786dd2bce12d1fe2 (patch) | |
| tree | 1fe8e75458092bea88180377061c8b4570016c1e /docs/configuration.md | |
| parent | d5af9e160e6e1927aa79605df3704ddd7a3f82ad (diff) | |
| download | spark-6f150978477830bbc14ba983786dd2bce12d1fe2.tar.gz spark-6f150978477830bbc14ba983786dd2bce12d1fe2.tar.bz2 spark-6f150978477830bbc14ba983786dd2bce12d1fe2.zip | |
[SPARK-3535][Mesos] Fix resource handling.
Author: Brenden Matthews <brenden@diddyinc.com>
Closes #2401 from brndnmtthws/master and squashes the following commits:
4abaa5d [Brenden Matthews] [SPARK-3535][Mesos] Fix resource handling.
(cherry picked from commit a8c52d5343e19731909e73db5de151a324d31cd5)
Signed-off-by: Andrew Or <andrewor14@gmail.com>
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 11 |
1 files changed, 11 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index c5065709f6..3b5751a982 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -224,6 +224,17 @@ Apart from these, the following properties are also available, and may be useful <code>spark.executor.uri</code>. </td> </tr> +<tr> + <td><code>spark.mesos.executor.memoryOverhead</code></td> + <td>executor memory * 0.07, with minimum of 384</td> + <td> + This value is an additive for <code>spark.executor.memory</code>, specified in MiB, + which is used to calculate the total Mesos task memory. A value of <code>384</code> + implies a 384MiB overhead. Additionally, there is a hard-coded 7% minimum + overhead. The final overhead will be the larger of either + `spark.mesos.executor.memoryOverhead` or 7% of `spark.executor.memory`. + </td> +</tr> </table> #### Shuffle Behavior |