diff options
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/configuration.md | 3 | ||||
| -rw-r--r-- | docs/running-on-yarn.md | 2 |
2 files changed, 4 insertions, 1 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index fbda91c109..cee59cf2aa 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1236,6 +1236,9 @@ Apart from these, the following properties are also available, and may be useful <td><code>spark.dynamicAllocation.minExecutors</code></td> <td> Initial number of executors to run if dynamic allocation is enabled. + <br /><br /> + If `--num-executors` (or `spark.executor.instances`) is set and larger than this value, it will + be used as the initial number of executors. </td> </tr> <tr> diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 9833806716..dbd46cc48c 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -244,7 +244,7 @@ To use a custom metrics.properties for the application master and executors, upd <td><code>spark.executor.instances</code></td> <td><code>2</code></td> <td> - The number of executors. Note that this property is incompatible with <code>spark.dynamicAllocation.enabled</code>. If both <code>spark.dynamicAllocation.enabled</code> and <code>spark.executor.instances</code> are specified, dynamic allocation is turned off and the specified number of <code>spark.executor.instances</code> is used. + The number of executors for static allocation. With <code>spark.dynamicAllocation.enabled</code>, the initial set of executors will be at least this large. </td> </tr> <tr> |