From 6c56fff118ff2380c661456755db17976040de66 Mon Sep 17 00:00:00 2001 From: Tom Graves Date: Fri, 22 Jul 2016 12:41:38 +0100 Subject: [SPARK-16650] Improve documentation of spark.task.maxFailures Clarify documentation on spark.task.maxFailures No tests run as its documentation Author: Tom Graves Closes #14287 from tgravescs/SPARK-16650. --- docs/configuration.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) (limited to 'docs') diff --git a/docs/configuration.md b/docs/configuration.md index 1e95b86244..86a9bd97d3 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1188,7 +1188,9 @@ Apart from these, the following properties are also available, and may be useful spark.task.maxFailures 4 - Number of individual task failures before giving up on the job. + Number of failures of any particular task before giving up on the job. + The total number of failures spread across different tasks will not cause the job + to fail; a particular task has to fail this number of attempts. Should be greater than or equal to 1. Number of allowed retries = this value - 1. -- cgit v1.2.3