diff options
| author | CodingCat <zhunansjtu@gmail.com> | 2015-07-31 20:27:00 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-07-31 20:27:00 +0100 |
| commit | c0686668ae6a92b6bb4801a55c3b78aedbee816a (patch) | |
| tree | f0a88c5c1a71e13b62f50268863483302410873e /docs/configuration.md | |
| parent | a8340fa7df17e3f0a3658f8b8045ab840845a72a (diff) | |
| download | spark-c0686668ae6a92b6bb4801a55c3b78aedbee816a.tar.gz spark-c0686668ae6a92b6bb4801a55c3b78aedbee816a.tar.bz2 spark-c0686668ae6a92b6bb4801a55c3b78aedbee816a.zip | |
[SPARK-9202] capping maximum number of executor&driver information kept in Worker
https://issues.apache.org/jira/browse/SPARK-9202
Author: CodingCat <zhunansjtu@gmail.com>
Closes #7714 from CodingCat/SPARK-9202 and squashes the following commits:
23977fb [CodingCat] add comments about why we don't synchronize finishedExecutors & finishedDrivers
dc9772d [CodingCat] addressing the comments
e125241 [CodingCat] stylistic fix
80bfe52 [CodingCat] fix JsonProtocolSuite
d7d9485 [CodingCat] styistic fix and respect insert ordering
031755f [CodingCat] add license info & stylistic fix
c3b5361 [CodingCat] test cases and docs
c557b3a [CodingCat] applications are fine
9cac751 [CodingCat] application is fine...
ad87ed7 [CodingCat] trimFinishedExecutorsAndDrivers
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 14 |
1 files changed, 14 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index fd236137cb..24b606356a 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -557,6 +557,20 @@ Apart from these, the following properties are also available, and may be useful collecting. </td> </tr> +<tr> + <td><code>spark.worker.ui.retainedExecutors</code></td> + <td>1000</td> + <td> + How many finished executors the Spark UI and status APIs remember before garbage collecting. + </td> +</tr> +<tr> + <td><code>spark.worker.ui.retainedDrivers</code></td> + <td>1000</td> + <td> + How many finished drivers the Spark UI and status APIs remember before garbage collecting. + </td> +</tr> </table> #### Compression and Serialization |