diff options
| author | Tom Graves <tgraves@yahoo-inc.com> | 2016-07-22 12:41:38 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2016-07-22 12:41:38 +0100 |
| commit | 6c56fff118ff2380c661456755db17976040de66 (patch) | |
| tree | 6cb48672d9dd55321d1443768dede35609df680b /docs/configuration.md | |
| parent | b4e16bd582d998235bfa061f7ade9f23fdfff05e (diff) | |
| download | spark-6c56fff118ff2380c661456755db17976040de66.tar.gz spark-6c56fff118ff2380c661456755db17976040de66.tar.bz2 spark-6c56fff118ff2380c661456755db17976040de66.zip | |
[SPARK-16650] Improve documentation of spark.task.maxFailures
Clarify documentation on spark.task.maxFailures
No tests run as its documentation
Author: Tom Graves <tgraves@yahoo-inc.com>
Closes #14287 from tgravescs/SPARK-16650.
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 4 |
1 files changed, 3 insertions, 1 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 1e95b86244..86a9bd97d3 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1188,7 +1188,9 @@ Apart from these, the following properties are also available, and may be useful <td><code>spark.task.maxFailures</code></td> <td>4</td> <td> - Number of individual task failures before giving up on the job. + Number of failures of any particular task before giving up on the job. + The total number of failures spread across different tasks will not cause the job + to fail; a particular task has to fail this number of attempts. Should be greater than or equal to 1. Number of allowed retries = this value - 1. </td> </tr> |