diff options
| author | saturday_s <shi.indetail@gmail.com> | 2016-12-22 12:51:37 -0800 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2016-12-22 12:51:37 -0800 |
| commit | ce99f51d2e8cbcb1565c9e7a729183bd74a0c2bc (patch) | |
| tree | 95c16fa2220409a658202776d9d70a2ed849d636 /project/MimaExcludes.scala | |
| parent | 31da755c80aed8219c368fd18c72b42e50be46fc (diff) | |
| download | spark-ce99f51d2e8cbcb1565c9e7a729183bd74a0c2bc.tar.gz spark-ce99f51d2e8cbcb1565c9e7a729183bd74a0c2bc.tar.bz2 spark-ce99f51d2e8cbcb1565c9e7a729183bd74a0c2bc.zip | |
[SPARK-18537][WEB UI] Add a REST api to serve spark streaming information
## What changes were proposed in this pull request?
This PR is an inheritance from #16000, and is a completion of #15904.
**Description**
- Augment the `org.apache.spark.status.api.v1` package for serving streaming information.
- Retrieve the streaming information through StreamingJobProgressListener.
> this api should cover exceptly the same amount of information as you can get from the web interface
> the implementation is base on the current REST implementation of spark-core
> and will be available for running applications only
>
> https://issues.apache.org/jira/browse/SPARK-18537
## How was this patch tested?
Local test.
Author: saturday_s <shi.indetail@gmail.com>
Author: Chan Chor Pang <ChorPang.Chan@access-company.com>
Author: peterCPChan <universknight@gmail.com>
Closes #16253 from saturday-shi/SPARK-18537.
Diffstat (limited to 'project/MimaExcludes.scala')
| -rw-r--r-- | project/MimaExcludes.scala | 6 |
1 files changed, 5 insertions, 1 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 20f5c2789a..2314d7f45c 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -38,8 +38,12 @@ object MimaExcludes { lazy val v22excludes = v21excludes ++ Seq( // [SPARK-18663][SQL] Simplify CountMinSketch aggregate implementation ProblemFilters.exclude[ReversedMissingMethodProblem]("org.apache.spark.util.sketch.CountMinSketch.toByteArray"), + // [SPARK-18949] [SQL] Add repairTable API to Catalog - ProblemFilters.exclude[ReversedMissingMethodProblem]("org.apache.spark.sql.catalog.Catalog.recoverPartitions") + ProblemFilters.exclude[ReversedMissingMethodProblem]("org.apache.spark.sql.catalog.Catalog.recoverPartitions"), + + // [SPARK-18537] Add a REST api to spark streaming + ProblemFilters.exclude[ReversedMissingMethodProblem]("org.apache.spark.streaming.scheduler.StreamingListener.onStreamingStarted") ) // Exclude rules for 2.1.x |