diff options
| author | Masayoshi TSUZUKI <tsudukim@oss.nttdata.co.jp> | 2014-12-03 13:16:24 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2014-12-03 13:16:24 -0800 |
| commit | 692f49378f7d384d5c9c5ab7451a1c1e66f91c50 (patch) | |
| tree | fd8401ded210f96e663d8d7f526c2bad9c28ce5d /docs/running-on-yarn.md | |
| parent | edd3cd477c9d6016bd977c2fa692fdeff5a6e198 (diff) | |
| download | spark-692f49378f7d384d5c9c5ab7451a1c1e66f91c50.tar.gz spark-692f49378f7d384d5c9c5ab7451a1c1e66f91c50.tar.bz2 spark-692f49378f7d384d5c9c5ab7451a1c1e66f91c50.zip | |
[SPARK-4642] Add description about spark.yarn.queue to running-on-YARN document.
Added descriptions about these parameters.
- spark.yarn.queue
Modified description about the defalut value of this parameter.
- spark.yarn.submit.file.replication
Author: Masayoshi TSUZUKI <tsudukim@oss.nttdata.co.jp>
Closes #3500 from tsudukim/feature/SPARK-4642 and squashes the following commits:
ce99655 [Masayoshi TSUZUKI] better gramatically.
21cf624 [Masayoshi TSUZUKI] Removed intentionally undocumented properties.
88cac9b [Masayoshi TSUZUKI] [SPARK-4642] Documents about running-on-YARN needs update
Diffstat (limited to 'docs/running-on-yarn.md')
| -rw-r--r-- | docs/running-on-yarn.md | 9 |
1 files changed, 8 insertions, 1 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 45e219e0c1..e97ac9f0c4 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -30,7 +30,7 @@ Most of the configs are the same for Spark on YARN as for other deployment modes </tr> <tr> <td><code>spark.yarn.submit.file.replication</code></td> - <td>3</td> + <td>The default HDFS replication (usually 3)</td> <td> HDFS replication level for the files uploaded into HDFS for the application. These include things like the Spark jar, the app jar, and any distributed cache files/archives. </td> @@ -92,6 +92,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes </td> </tr> <tr> + <td><code>spark.yarn.queue</code></td> + <td>default</td> + <td> + The name of the YARN queue to which the application is submitted. + </td> +</tr> +<tr> <td><code>spark.yarn.jar</code></td> <td>(none)</td> <td> |