diff options
| author | Brenden Matthews <brenden@diddyinc.com> | 2014-10-03 12:58:04 -0700 |
|---|---|---|
| committer | Andrew Or <andrewor14@gmail.com> | 2014-10-03 12:58:04 -0700 |
| commit | a8c52d5343e19731909e73db5de151a324d31cd5 (patch) | |
| tree | 909977e4bcc39fafd43de8c60d327bd224cdee7d /docs/configuration.md | |
| parent | 6a1d48f4f02c4498b64439c3dd5f671286a90e30 (diff) | |
| download | spark-a8c52d5343e19731909e73db5de151a324d31cd5.tar.gz spark-a8c52d5343e19731909e73db5de151a324d31cd5.tar.bz2 spark-a8c52d5343e19731909e73db5de151a324d31cd5.zip | |
[SPARK-3535][Mesos] Fix resource handling.
Author: Brenden Matthews <brenden@diddyinc.com>
Closes #2401 from brndnmtthws/master and squashes the following commits:
4abaa5d [Brenden Matthews] [SPARK-3535][Mesos] Fix resource handling.
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 11 |
1 files changed, 11 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index a782809a55..1c33855365 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -253,6 +253,17 @@ Apart from these, the following properties are also available, and may be useful <code>spark.executor.uri</code>. </td> </tr> +<tr> + <td><code>spark.mesos.executor.memoryOverhead</code></td> + <td>executor memory * 0.07, with minimum of 384</td> + <td> + This value is an additive for <code>spark.executor.memory</code>, specified in MiB, + which is used to calculate the total Mesos task memory. A value of <code>384</code> + implies a 384MiB overhead. Additionally, there is a hard-coded 7% minimum + overhead. The final overhead will be the larger of either + `spark.mesos.executor.memoryOverhead` or 7% of `spark.executor.memory`. + </td> +</tr> </table> #### Shuffle Behavior |