diff options
| author | Timothy Chen <tnachen@gmail.com> | 2016-02-01 12:45:02 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2016-02-01 12:45:02 -0800 |
| commit | 51b03b71ffc390e67b32936efba61e614a8b0d86 (patch) | |
| tree | e4f30c0054c46d8a52a8d7b1dd97045de5c53023 /docs/configuration.md | |
| parent | 711ce048a285403241bbc9eaabffc1314162e89c (diff) | |
| download | spark-51b03b71ffc390e67b32936efba61e614a8b0d86.tar.gz spark-51b03b71ffc390e67b32936efba61e614a8b0d86.tar.bz2 spark-51b03b71ffc390e67b32936efba61e614a8b0d86.zip | |
[SPARK-12463][SPARK-12464][SPARK-12465][SPARK-10647][MESOS] Fix zookeeper dir with mesos conf and add docs.
Fix zookeeper dir configuration used in cluster mode, and also add documentation around these settings.
Author: Timothy Chen <tnachen@gmail.com>
Closes #10057 from tnachen/fix_mesos_dir.
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 23 |
1 files changed, 23 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 74a8fb5d35..93b399d819 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1585,6 +1585,29 @@ Apart from these, the following properties are also available, and may be useful </tr> </table> +#### Deploy + +<table class="table"> + <tr><th>Property Name</th><th>Default</th><th>Meaniing</th></tr> + <tr> + <td><code>spark.deploy.recoveryMode</code></td> + <td>NONE</td> + <td>The recovery mode setting to recover submitted Spark jobs with cluster mode when it failed and relaunches. + This is only applicable for cluster mode when running with Standalone or Mesos.</td> + </tr> + <tr> + <td><code>spark.deploy.zookeeper.url</code></td> + <td>None</td> + <td>When `spark.deploy.recoveryMode` is set to ZOOKEEPER, this configuration is used to set the zookeeper URL to connect to.</td> + </tr> + <tr> + <td><code>spark.deploy.zookeeper.dir</code></td> + <td>None</td> + <td>When `spark.deploy.recoveryMode` is set to ZOOKEEPER, this configuration is used to set the zookeeper directory to store recovery state.</td> + </tr> +</table> + + #### Cluster Managers Each cluster manager in Spark has additional configuration options. Configurations can be found on the pages for each mode: |