diff options
| author | Masayoshi TSUZUKI <tsudukim@oss.nttdata.co.jp> | 2014-12-03 13:16:24 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2014-12-03 13:19:48 -0800 |
| commit | 4a71e08534b92710fd8d1eb17b077c6c7b78e55d (patch) | |
| tree | 3f5321929d6c1bb3bdca20584e3de21a252c584c /docs | |
| parent | 1ee65b4f98f5db397f447047acda2179fee6c7c0 (diff) | |
| download | spark-4a71e08534b92710fd8d1eb17b077c6c7b78e55d.tar.gz spark-4a71e08534b92710fd8d1eb17b077c6c7b78e55d.tar.bz2 spark-4a71e08534b92710fd8d1eb17b077c6c7b78e55d.zip | |
[SPARK-4642] Add description about spark.yarn.queue to running-on-YARN document.
Added descriptions about these parameters.
- spark.yarn.queue
Modified description about the defalut value of this parameter.
- spark.yarn.submit.file.replication
Author: Masayoshi TSUZUKI <tsudukim@oss.nttdata.co.jp>
Closes #3500 from tsudukim/feature/SPARK-4642 and squashes the following commits:
ce99655 [Masayoshi TSUZUKI] better gramatically.
21cf624 [Masayoshi TSUZUKI] Removed intentionally undocumented properties.
88cac9b [Masayoshi TSUZUKI] [SPARK-4642] Documents about running-on-YARN needs update
(cherry picked from commit 692f49378f7d384d5c9c5ab7451a1c1e66f91c50)
Signed-off-by: Andrew Or <andrew@databricks.com>
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/running-on-yarn.md | 9 |
1 files changed, 8 insertions, 1 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index a98259c08d..abfd7164b4 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -30,7 +30,7 @@ Most of the configs are the same for Spark on YARN as for other deployment modes </tr> <tr> <td><code>spark.yarn.submit.file.replication</code></td> - <td>3</td> + <td>The default HDFS replication (usually 3)</td> <td> HDFS replication level for the files uploaded into HDFS for the application. These include things like the Spark jar, the app jar, and any distributed cache files/archives. </td> @@ -92,6 +92,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes </td> </tr> <tr> + <td><code>spark.yarn.queue</code></td> + <td>default</td> + <td> + The name of the YARN queue to which the application is submitted. + </td> +</tr> +<tr> <td><code>spark.yarn.jar</code></td> <td>(none)</td> <td> |