diff options
| author | WangTaoTheTonic <wangtao111@huawei.com> | 2015-02-06 11:57:02 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-02-06 11:58:22 -0800 |
| commit | d34f79c8db79ae461fadae190446ebc19091bec9 (patch) | |
| tree | b5b9764765f2061c842bba110f2058373c863a7a /docs/running-on-yarn.md | |
| parent | af2a2a263ac5d890e84d012b75fcb50e02c9ede8 (diff) | |
| download | spark-d34f79c8db79ae461fadae190446ebc19091bec9.tar.gz spark-d34f79c8db79ae461fadae190446ebc19091bec9.tar.bz2 spark-d34f79c8db79ae461fadae190446ebc19091bec9.zip | |
[SPARK-2945][YARN][Doc]add doc for spark.executor.instances
https://issues.apache.org/jira/browse/SPARK-2945
spark.executor.instances works. As this JIRA recommended, we should add docs for this common config.
Author: WangTaoTheTonic <wangtao111@huawei.com>
Closes #4350 from WangTaoTheTonic/SPARK-2945 and squashes the following commits:
4c3913a [WangTaoTheTonic] not compatible with dynamic allocation
5fa9c46 [WangTaoTheTonic] add doc for spark.executor.instances
Diffstat (limited to 'docs/running-on-yarn.md')
| -rw-r--r-- | docs/running-on-yarn.md | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 68ab127bcf..2b93eef6c2 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -105,6 +105,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes </td> </tr> <tr> + <td><code>spark.executor.instances</code></td> + <td>2</td> + <td> + The number of executors. Note that this property is incompatible with <code>spark.dynamicAllocation.enabled</code>. + </td> +</tr> +<tr> <td><code>spark.yarn.executor.memoryOverhead</code></td> <td>executorMemory * 0.07, with minimum of 384 </td> <td> |