diff options
| author | Wenchen Fan <wenchen@databricks.com> | 2017-01-17 12:54:50 +0800 |
|---|---|---|
| committer | Wenchen Fan <wenchen@databricks.com> | 2017-01-17 12:54:50 +0800 |
| commit | 18ee55dd5de0597d7fb69e8e16ac3744356a6918 (patch) | |
| tree | eb2b6ac905b50ff621923da1d601c104f2cbb418 /project | |
| parent | f8db8945f25cb884278ff8841bac5f6f28f0dec6 (diff) | |
| download | spark-18ee55dd5de0597d7fb69e8e16ac3744356a6918.tar.gz spark-18ee55dd5de0597d7fb69e8e16ac3744356a6918.tar.bz2 spark-18ee55dd5de0597d7fb69e8e16ac3744356a6918.zip | |
[SPARK-19148][SQL] do not expose the external table concept in Catalog
## What changes were proposed in this pull request?
In https://github.com/apache/spark/pull/16296 , we reached a consensus that we should hide the external/managed table concept to users and only expose custom table path.
This PR renames `Catalog.createExternalTable` to `createTable`(still keep the old versions for backward compatibility), and only set the table type to EXTERNAL if `path` is specified in options.
## How was this patch tested?
new tests in `CatalogSuite`
Author: Wenchen Fan <wenchen@databricks.com>
Closes #16528 from cloud-fan/create-table.
Diffstat (limited to 'project')
| -rw-r--r-- | project/MimaExcludes.scala | 5 |
1 files changed, 4 insertions, 1 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 2314d7f45c..e0ee00e682 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -43,7 +43,10 @@ object MimaExcludes { ProblemFilters.exclude[ReversedMissingMethodProblem]("org.apache.spark.sql.catalog.Catalog.recoverPartitions"), // [SPARK-18537] Add a REST api to spark streaming - ProblemFilters.exclude[ReversedMissingMethodProblem]("org.apache.spark.streaming.scheduler.StreamingListener.onStreamingStarted") + ProblemFilters.exclude[ReversedMissingMethodProblem]("org.apache.spark.streaming.scheduler.StreamingListener.onStreamingStarted"), + + // [SPARK-19148][SQL] do not expose the external table concept in Catalog + ProblemFilters.exclude[ReversedMissingMethodProblem]("org.apache.spark.sql.catalog.Catalog.createTable") ) // Exclude rules for 2.1.x |