diff options
| author | WangTaoTheTonic <barneystinson@aliyun.com> | 2015-01-07 08:14:39 -0600 |
|---|---|---|
| committer | Thomas Graves <tgraves@apache.org> | 2015-01-07 08:14:39 -0600 |
| commit | 8fdd48959c93b9cf809f03549e2ae6c4687d1fcd (patch) | |
| tree | 2e20bce18b10a53ca05b99e42ecab3ff19c1bd29 /docs/running-on-yarn.md | |
| parent | 5fde66163fe460d6f64b145047f76cc4ee33601a (diff) | |
| download | spark-8fdd48959c93b9cf809f03549e2ae6c4687d1fcd.tar.gz spark-8fdd48959c93b9cf809f03549e2ae6c4687d1fcd.tar.bz2 spark-8fdd48959c93b9cf809f03549e2ae6c4687d1fcd.zip | |
[SPARK-2165][YARN]add support for setting maxAppAttempts in the ApplicationSubmissionContext
...xt
https://issues.apache.org/jira/browse/SPARK-2165
I still have 2 questions:
* If this config is not set, we should use yarn's corresponding value or a default value(like 2) on spark side?
* Is the config name best? Or "spark.yarn.am.maxAttempts"?
Author: WangTaoTheTonic <barneystinson@aliyun.com>
Closes #3878 from WangTaoTheTonic/SPARK-2165 and squashes the following commits:
1416c83 [WangTaoTheTonic] use the name spark.yarn.maxAppAttempts
202ac85 [WangTaoTheTonic] rephrase some
afdfc99 [WangTaoTheTonic] more detailed description
91562c6 [WangTaoTheTonic] add support for setting maxAppAttempts in the ApplicationSubmissionContext
Diffstat (limited to 'docs/running-on-yarn.md')
| -rw-r--r-- | docs/running-on-yarn.md | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index da1c8e8aa8..183698ffe9 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -149,6 +149,14 @@ Most of the configs are the same for Spark on YARN as for other deployment modes In cluster mode, use spark.driver.extraJavaOptions instead. </td> </tr> +<tr> + <td><code>spark.yarn.maxAppAttempts</code></td> + <td>yarn.resourcemanager.am.max-attempts in YARN</td> + <td> + The maximum number of attempts that will be made to submit the application. + It should be no larger than the global number of max attempts in the YARN configuration. + </td> +</tr> </table> # Launching Spark on YARN |