diff options
| author | lianhuiwang <lianhuiwang09@gmail.com> | 2014-07-19 20:46:59 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-07-19 20:46:59 -0700 |
| commit | 4da01e3813f0a0413fe691358c14278bbd5508ed (patch) | |
| tree | 5cc4499410eecaafc001810770439317b3932e70 /docs/spark-standalone.md | |
| parent | c11949878d650ed776b190444b198dbdacb0c5d7 (diff) | |
| download | spark-4da01e3813f0a0413fe691358c14278bbd5508ed.tar.gz spark-4da01e3813f0a0413fe691358c14278bbd5508ed.tar.bz2 spark-4da01e3813f0a0413fe691358c14278bbd5508ed.zip | |
[SPARK-2524] missing document about spark.deploy.retainedDrivers
https://issues.apache.org/jira/browse/SPARK-2524
The configuration on spark.deploy.retainedDrivers is undocumented but actually used
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/master/Master.scala#L60
Author: lianhuiwang <lianhuiwang09@gmail.com>
Author: Wang Lianhui <lianhuiwang09@gmail.com>
Author: unknown <Administrator@taguswang-PC1.tencent.com>
Closes #1443 from lianhuiwang/SPARK-2524 and squashes the following commits:
64660fd [Wang Lianhui] address pwendell's comments
5f6bbb7 [Wang Lianhui] missing document about spark.deploy.retainedDrivers
44a3f50 [unknown] Merge remote-tracking branch 'upstream/master'
eacf933 [lianhuiwang] Merge remote-tracking branch 'upstream/master'
8bbfe76 [lianhuiwang] Merge remote-tracking branch 'upstream/master'
480ce94 [lianhuiwang] address aarondav comments
f2b5970 [lianhuiwang] bugfix worker DriverStateChanged state should match DriverState.FAILED
Diffstat (limited to 'docs/spark-standalone.md')
| -rw-r--r-- | docs/spark-standalone.md | 14 |
1 files changed, 14 insertions, 0 deletions
diff --git a/docs/spark-standalone.md b/docs/spark-standalone.md index f5c0f7cef8..ad8b6c0e51 100644 --- a/docs/spark-standalone.md +++ b/docs/spark-standalone.md @@ -157,6 +157,20 @@ SPARK_MASTER_OPTS supports the following system properties: <table class="table"> <tr><th>Property Name</th><th>Default</th><th>Meaning</th></tr> <tr> + <td><code>spark.deploy.retainedApplications</code></td> + <td>200</td> + <td> + The maximum number of completed applications to display. Older applications will be dropped from the UI to maintain this limit.<br/> + </td> +</tr> +<tr> + <td><code>spark.deploy.retainedDrivers</code></td> + <td>200</td> + <td> + The maximum number of completed drivers to display. Older drivers will be dropped from the UI to maintain this limit.<br/> + </td> +</tr> +<tr> <td><code>spark.deploy.spreadOut</code></td> <td>true</td> <td> |