diff options
| author | jerryshao <sshao@hortonworks.com> | 2015-10-12 18:17:28 -0700 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2015-10-12 18:18:19 -0700 |
| commit | f97e9323b526b3d0b0fee0ca03f4276f37bb5750 (patch) | |
| tree | bdeb2b7b2c07f84c71c5cc1f6ce7f988ca7acd70 /docs | |
| parent | 091c2c3ecd69803d78c2b15a1487046701059d38 (diff) | |
| download | spark-f97e9323b526b3d0b0fee0ca03f4276f37bb5750.tar.gz spark-f97e9323b526b3d0b0fee0ca03f4276f37bb5750.tar.bz2 spark-f97e9323b526b3d0b0fee0ca03f4276f37bb5750.zip | |
[SPARK-10739] [YARN] Add application attempt window for Spark on Yarn
Add application attempt window for Spark on Yarn to ignore old out of window failures, this is useful for long running applications to recover from failures.
Author: jerryshao <sshao@hortonworks.com>
Closes #8857 from jerryshao/SPARK-10739 and squashes the following commits:
36eabdc [jerryshao] change the doc
7f9b77d [jerryshao] Style change
1c9afd0 [jerryshao] Address the comments
caca695 [jerryshao] Add application attempt window for Spark on Yarn
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/running-on-yarn.md | 9 |
1 files changed, 9 insertions, 0 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 6d77db6a32..677c000044 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -306,6 +306,15 @@ If you need a reference to the proper location to put log files in the YARN so t </td> </tr> <tr> + <td><code>spark.yarn.am.attemptFailuresValidityInterval</code></td> + <td>(none)</td> + <td> + Defines the validity interval for AM failure tracking. + If the AM has been running for at least the defined interval, the AM failure count will be reset. + This feature is not enabled if not configured, and only supported in Hadoop 2.6+. + </td> +</tr> +<tr> <td><code>spark.yarn.submit.waitAppCompletion</code></td> <td><code>true</code></td> <td> |