diff options
| author | Dhruve Ashar <dashar@yahoo-inc.com> | 2016-09-22 10:10:37 -0700 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2016-09-22 10:10:37 -0700 |
| commit | 17b72d31e0c59711eddeb525becb8085930eadcc (patch) | |
| tree | 89c82299dc5a3a6be368d78b9dd3caa64e1e5ec7 /project | |
| parent | 8a02410a92429bff50d6ce082f873cea9e9fa91e (diff) | |
| download | spark-17b72d31e0c59711eddeb525becb8085930eadcc.tar.gz spark-17b72d31e0c59711eddeb525becb8085930eadcc.tar.bz2 spark-17b72d31e0c59711eddeb525becb8085930eadcc.zip | |
[SPARK-17365][CORE] Remove/Kill multiple executors together to reduce RPC call time.
## What changes were proposed in this pull request?
We are killing multiple executors together instead of iterating over expensive RPC calls to kill single executor.
## How was this patch tested?
Executed sample spark job to observe executors being killed/removed with dynamic allocation enabled.
Author: Dhruve Ashar <dashar@yahoo-inc.com>
Author: Dhruve Ashar <dhruveashar@gmail.com>
Closes #15152 from dhruve/impr/SPARK-17365.
Diffstat (limited to 'project')
| -rw-r--r-- | project/MimaExcludes.scala | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index f13f3ff789..0a56a6b19e 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -818,6 +818,9 @@ object MimaExcludes { ) ++ Seq( // [SPARK-17017] Add chiSquare selector based on False Positive Rate (FPR) test ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.mllib.feature.ChiSqSelectorModel.isSorted") + ) ++ Seq( + // [SPARK-17365][Core] Remove/Kill multiple executors together to reduce RPC call time + ProblemFilters.exclude[MissingTypesProblem]("org.apache.spark.SparkContext") ) } |