diff options
| author | Yin Huai <yhuai@databricks.com> | 2016-07-19 12:58:08 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-07-19 12:58:08 -0700 |
| commit | 2ae7b88a07140e012b6c60db3c4a2a8ca360c684 (patch) | |
| tree | 568117437207ea002227fda021fd82601fe7ee79 /sql/hive/src | |
| parent | 162d04a30e38bb83d35865679145f8ea80b84c26 (diff) | |
| download | spark-2ae7b88a07140e012b6c60db3c4a2a8ca360c684.tar.gz spark-2ae7b88a07140e012b6c60db3c4a2a8ca360c684.tar.bz2 spark-2ae7b88a07140e012b6c60db3c4a2a8ca360c684.zip | |
[SPARK-15705][SQL] Change the default value of spark.sql.hive.convertMetastoreOrc to false.
## What changes were proposed in this pull request?
In 2.0, we add a new logic to convert HiveTableScan on ORC tables to Spark's native code path. However, during this conversion, we drop the original metastore schema (https://issues.apache.org/jira/browse/SPARK-15705). Because of this regression, I am changing the default value of `spark.sql.hive.convertMetastoreOrc` to false.
Author: Yin Huai <yhuai@databricks.com>
Closes #14267 from yhuai/SPARK-15705-changeDefaultValue.
Diffstat (limited to 'sql/hive/src')
| -rw-r--r-- | sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala index 9ed357c587..bdec611453 100644 --- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala +++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala @@ -97,10 +97,11 @@ private[spark] object HiveUtils extends Logging { .createWithDefault(false) val CONVERT_METASTORE_ORC = SQLConfigBuilder("spark.sql.hive.convertMetastoreOrc") + .internal() .doc("When set to false, Spark SQL will use the Hive SerDe for ORC tables instead of " + "the built in support.") .booleanConf - .createWithDefault(true) + .createWithDefault(false) val HIVE_METASTORE_SHARED_PREFIXES = SQLConfigBuilder("spark.sql.hive.metastore.sharedPrefixes") .doc("A comma separated list of class prefixes that should be loaded using the classloader " + |