diff options
| author | windpiger <songjun@outlook.com> | 2017-02-23 22:57:23 -0800 |
|---|---|---|
| committer | Wenchen Fan <wenchen@databricks.com> | 2017-02-23 22:57:23 -0800 |
| commit | 8f33731e796750e6f60dc9e2fc33a94d29d198b4 (patch) | |
| tree | b61ffee3dc3ee046898ba6fb34185be7883f28d1 /python/pyspark/sql/tests.py | |
| parent | d7e43b613aeb6d85b8522d7c16c6e0807843c964 (diff) | |
| download | spark-8f33731e796750e6f60dc9e2fc33a94d29d198b4.tar.gz spark-8f33731e796750e6f60dc9e2fc33a94d29d198b4.tar.bz2 spark-8f33731e796750e6f60dc9e2fc33a94d29d198b4.zip | |
[SPARK-19664][SQL] put hive.metastore.warehouse.dir in hadoopconf to overwrite its original value
## What changes were proposed in this pull request?
In [SPARK-15959](https://issues.apache.org/jira/browse/SPARK-15959), we bring back the `hive.metastore.warehouse.dir` , while in the logic, when use the value of `spark.sql.warehouse.dir` to overwrite `hive.metastore.warehouse.dir` , it set it to `sparkContext.conf` which does not overwrite the value is hadoopConf, I think it should put in `sparkContext.hadoopConfiguration` and overwrite the original value of hadoopConf
https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/internal/SharedState.scala#L64
## How was this patch tested?
N/A
Author: windpiger <songjun@outlook.com>
Closes #16996 from windpiger/hivemetawarehouseConf.
Diffstat (limited to 'python/pyspark/sql/tests.py')
0 files changed, 0 insertions, 0 deletions