diff options
| author | BenFradet <benjamin.fradet@gmail.com> | 2015-05-02 23:41:14 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-05-02 23:41:14 +0100 |
| commit | ea841efc5a67e9a64a4ec803d31e4023b565c327 (patch) | |
| tree | 9d6e7e0f01497d0fa5fa6ae72dd686e1932c466d /docs | |
| parent | 5d6b90d939d281130c786be38fd1794c74391b08 (diff) | |
| download | spark-ea841efc5a67e9a64a4ec803d31e4023b565c327.tar.gz spark-ea841efc5a67e9a64a4ec803d31e4023b565c327.tar.bz2 spark-ea841efc5a67e9a64a4ec803d31e4023b565c327.zip | |
[SPARK-7255] [STREAMING] [DOCUMENTATION] Added documentation for spark.streaming.kafka.maxRetries
Added documentation for spark.streaming.kafka.maxRetries
Author: BenFradet <benjamin.fradet@gmail.com>
Closes #5808 from BenFradet/master and squashes the following commits:
cc72e7a [BenFradet] updated doc for spark.streaming.kafka.maxRetries to explain the default value
18f823e [BenFradet] Added "consecutive" to the spark.streaming.kafka.maxRetries doc
597fdeb [BenFradet] Mention that spark.streaming.kafka.maxRetries only applies to the direct kafka api
0efad39 [BenFradet] Added documentation for spark.streaming.kafka.maxRetries
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/configuration.md | 10 |
1 files changed, 10 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 7239b252a9..64066bc0d7 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1464,6 +1464,16 @@ Apart from these, the following properties are also available, and may be useful for more details. </td> </tr> +<tr> + <td><code>spark.streaming.kafka.maxRetries</code></td> + <td>1</td> + <td> + Maximum number of consecutive retries the driver will make in order to find + the latest offsets on the leader of each partition (a default value of 1 + means that the driver will make a maximum of 2 attempts). Only applies to + the new Kafka direct stream API. + </td> +</tr> </table> #### Cluster Managers |