diff options
| author | Wenchen Fan <wenchen@databricks.com> | 2016-04-19 21:20:24 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-04-19 21:20:24 -0700 |
| commit | 85d759ca3aebb7d60b963207dcada83c75502e52 (patch) | |
| tree | b4fbaba9dfce1ae47485f318123881f42cd05e6c /project/MimaExcludes.scala | |
| parent | 78b38109ed2fc20e97f9a968185d0c02ef83aa42 (diff) | |
| download | spark-85d759ca3aebb7d60b963207dcada83c75502e52.tar.gz spark-85d759ca3aebb7d60b963207dcada83c75502e52.tar.bz2 spark-85d759ca3aebb7d60b963207dcada83c75502e52.zip | |
[SPARK-14704][CORE] create accumulators in TaskMetrics
## What changes were proposed in this pull request?
Before this PR, we create accumulators at driver side(and register them) and send them to executor side, then we create `TaskMetrics` with these accumulators at executor side.
After this PR, we will create `TaskMetrics` at driver side and send it to executor side, so that we can create accumulators inside `TaskMetrics` directly, which is cleaner.
## How was this patch tested?
existing tests.
Author: Wenchen Fan <wenchen@databricks.com>
Closes #12472 from cloud-fan/acc.
Diffstat (limited to 'project/MimaExcludes.scala')
| -rw-r--r-- | project/MimaExcludes.scala | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 7b15f58558..65b0a97e4d 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -656,6 +656,10 @@ object MimaExcludes { // [SPARK-14407] Hides HadoopFsRelation related data source API into execution package ProblemFilters.exclude[MissingClassProblem]("org.apache.spark.sql.sources.OutputWriter"), ProblemFilters.exclude[MissingClassProblem]("org.apache.spark.sql.sources.OutputWriterFactory") + ) ++ Seq( + // SPARK-14704: Create accumulators in TaskMetrics + ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.executor.InputMetrics.this"), + ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.executor.OutputMetrics.this") ) case v if v.startsWith("1.6") => Seq( |