diff options
author | Andrew Or <andrew@databricks.com> | 2016-03-23 13:34:22 -0700 |
---|---|---|
committer | Reynold Xin <rxin@databricks.com> | 2016-03-23 13:34:22 -0700 |
commit | 5dfc01976bb0d72489620b4f32cc12d620bb6260 (patch) | |
tree | 18c0bef5f2c6b0099bd6e8b512b1718b75ecd015 /project | |
parent | 6bc4be64f86afcb38e4444c80c9400b7b6b745de (diff) | |
download | spark-5dfc01976bb0d72489620b4f32cc12d620bb6260.tar.gz spark-5dfc01976bb0d72489620b4f32cc12d620bb6260.tar.bz2 spark-5dfc01976bb0d72489620b4f32cc12d620bb6260.zip |
[SPARK-14014][SQL] Replace existing catalog with SessionCatalog
## What changes were proposed in this pull request?
`SessionCatalog`, introduced in #11750, is a catalog that keeps track of temporary functions and tables, and delegates metastore operations to `ExternalCatalog`. This functionality overlaps a lot with the existing `analysis.Catalog`.
As of this commit, `SessionCatalog` and `ExternalCatalog` will no longer be dead code. There are still things that need to be done after this patch, namely:
- SPARK-14013: Properly implement temporary functions in `SessionCatalog`
- SPARK-13879: Decide which DDL/DML commands to support natively in Spark
- SPARK-?????: Implement the ones we do want to support through `SessionCatalog`.
- SPARK-?????: Merge SQL/HiveContext
## How was this patch tested?
This is largely a refactoring task so there are no new tests introduced. The particularly relevant tests are `SessionCatalogSuite` and `ExternalCatalogSuite`.
Author: Andrew Or <andrew@databricks.com>
Author: Yin Huai <yhuai@databricks.com>
Closes #11836 from andrewor14/use-session-catalog.
Diffstat (limited to 'project')
-rw-r--r-- | project/MimaExcludes.scala | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 42eafcb0f5..915898389c 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -563,6 +563,9 @@ object MimaExcludes { ProblemFilters.exclude[ReversedMissingMethodProblem]("org.apache.spark.scheduler.SparkListenerEvent.logEvent"), ProblemFilters.exclude[ReversedMissingMethodProblem]("org.apache.spark.sql.sources.OutputWriterFactory.newInstance") ) ++ Seq( + // [SPARK-14014] Replace existing analysis.Catalog with SessionCatalog + ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.sql.SQLContext.this") + ) ++ Seq( // [SPARK-13928] Move org.apache.spark.Logging into org.apache.spark.internal.Logging ProblemFilters.exclude[MissingClassProblem]("org.apache.spark.Logging"), (problem: Problem) => problem match { |