diff options
| author | Sandy Ryza <sandy@cloudera.com> | 2014-09-10 14:34:24 -0500 |
|---|---|---|
| committer | Thomas Graves <tgraves@apache.org> | 2014-09-10 14:34:24 -0500 |
| commit | 1f4a648d4e30e837d6cf3ea8de1808e2254ad70b (patch) | |
| tree | 8387579c70ae84cea70e2de0df073f07dc7e5bcd /docs/running-on-yarn.md | |
| parent | 26503fdf20f4181a2b390c88b83f364e6a4ccc21 (diff) | |
| download | spark-1f4a648d4e30e837d6cf3ea8de1808e2254ad70b.tar.gz spark-1f4a648d4e30e837d6cf3ea8de1808e2254ad70b.tar.bz2 spark-1f4a648d4e30e837d6cf3ea8de1808e2254ad70b.zip | |
SPARK-1713. Use a thread pool for launching executors.
This patch copies the approach used in the MapReduce application master for launching containers.
Author: Sandy Ryza <sandy@cloudera.com>
Closes #663 from sryza/sandy-spark-1713 and squashes the following commits:
036550d [Sandy Ryza] SPARK-1713. [YARN] Use a threadpool for launching executor containers
Diffstat (limited to 'docs/running-on-yarn.md')
| -rw-r--r-- | docs/running-on-yarn.md | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 943f06b114..d8b22f3663 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -125,6 +125,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes the environment of the executor launcher. </td> </tr> +<tr> + <td><code>spark.yarn.containerLauncherMaxThreads</code></td> + <td>25</td> + <td> + The maximum number of threads to use in the application master for launching executor containers. + </td> +</tr> </table> # Launching Spark on YARN |