diff options
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 19 |
1 files changed, 19 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 24b606356a..c60dd16839 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -474,6 +474,25 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> + <td><code>spark.shuffle.service.enabled</code></td> + <td>false</td> + <td> + Enables the external shuffle service. This service preserves the shuffle files written by + executors so the executors can be safely removed. This must be enabled if + <code>spark.dynamicAllocation.enabled</code> is "true". The external shuffle service + must be set up in order to enable it. See + <a href="job-scheduling.html#configuration-and-setup">dynamic allocation + configuration and setup documentation</a> for more information. + </td> +</tr> +<tr> + <td><code>spark.shuffle.service.port</code></td> + <td>7337</td> + <td> + Port on which the external shuffle service will run. + </td> +</tr> +<tr> <td><code>spark.shuffle.sort.bypassMergeThreshold</code></td> <td>200</td> <td> |