From c99492141b1ddddb8edb6841a6e83748e5ba9bba Mon Sep 17 00:00:00 2001 From: Yuming Wang Date: Mon, 23 Jan 2017 11:02:22 +0000 Subject: [SPARK-19146][CORE] Drop more elements when stageData.taskData.size > retainedTasks ## What changes were proposed in this pull request? Drop more elements when `stageData.taskData.size > retainedTasks` to reduce the number of times on call drop function. ## How was this patch tested? Jenkins Author: Yuming Wang Closes #16527 from wangyum/SPARK-19146. --- docs/configuration.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) (limited to 'docs') diff --git a/docs/configuration.md b/docs/configuration.md index 7a11a983d5..a6b1f15fda 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -684,24 +684,24 @@ Apart from these, the following properties are also available, and may be useful spark.ui.retainedJobs 1000 - How many jobs the Spark UI and status APIs remember before garbage - collecting. + How many jobs the Spark UI and status APIs remember before garbage collecting. + This is a target maximum, and fewer elements may be retained in some circumstances. spark.ui.retainedStages 1000 - How many stages the Spark UI and status APIs remember before garbage - collecting. + How many stages the Spark UI and status APIs remember before garbage collecting. + This is a target maximum, and fewer elements may be retained in some circumstances. spark.ui.retainedTasks 100000 - How many tasks the Spark UI and status APIs remember before garbage - collecting. + How many tasks the Spark UI and status APIs remember before garbage collecting. + This is a target maximum, and fewer elements may be retained in some circumstances. -- cgit v1.2.3