diff options
| author | Wenchen Fan <wenchen@databricks.com> | 2016-11-17 17:31:12 -0800 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2016-11-17 17:31:12 -0800 |
| commit | ce13c2672318242748f7520ed4ce6bcfad4fb428 (patch) | |
| tree | 76d5ca2b6d5bd8b69dcf4bf97bb77d9c22d67b3c /sql/hive/compatibility | |
| parent | b0aa1aa1af6c513a6a881eaea96abdd2b480ef98 (diff) | |
| download | spark-ce13c2672318242748f7520ed4ce6bcfad4fb428.tar.gz spark-ce13c2672318242748f7520ed4ce6bcfad4fb428.tar.bz2 spark-ce13c2672318242748f7520ed4ce6bcfad4fb428.zip | |
[SPARK-18360][SQL] default table path of tables in default database should depend on the location of default database
## What changes were proposed in this pull request?
The current semantic of the warehouse config:
1. it's a static config, which means you can't change it once your spark application is launched.
2. Once a database is created, its location won't change even the warehouse path config is changed.
3. default database is a special case, although its location is fixed, but the locations of tables created in it are not. If a Spark app starts with warehouse path B(while the location of default database is A), then users create a table `tbl` in default database, its location will be `B/tbl` instead of `A/tbl`. If uses change the warehouse path config to C, and create another table `tbl2`, its location will still be `B/tbl2` instead of `C/tbl2`.
rule 3 doesn't make sense and I think we made it by mistake, not intentionally. Data source tables don't follow rule 3 and treat default database like normal ones.
This PR fixes hive serde tables to make it consistent with data source tables.
## How was this patch tested?
HiveSparkSubmitSuite
Author: Wenchen Fan <wenchen@databricks.com>
Closes #15812 from cloud-fan/default-db.
Diffstat (limited to 'sql/hive/compatibility')
0 files changed, 0 insertions, 0 deletions