diff options
| author | Artem Aliev <artem.aliev@datastax.com> | 2015-10-21 14:12:00 -0700 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2015-10-21 14:12:07 -0700 |
| commit | a37cd870489d7ff85455bf9b57d9aa5329514058 (patch) | |
| tree | cdd9a1939c3b954a251b4027e7a298b75b75eee4 | |
| parent | 3afe448d39dc4877b2f2c62b3059aeb3ced0bd96 (diff) | |
| download | spark-a37cd870489d7ff85455bf9b57d9aa5329514058.tar.gz spark-a37cd870489d7ff85455bf9b57d9aa5329514058.tar.bz2 spark-a37cd870489d7ff85455bf9b57d9aa5329514058.zip | |
[SPARK-11208][SQL] Filter out 'hive.metastore.rawstore.impl' from executionHive temporary config
The executionHive assumed to be a standard meta store located in temporary directory as a derby db. But hive.metastore.rawstore.impl was not filtered out so any custom implementation of the metastore with other storage properties (not JDO) will persist that temporary functions. CassandraHiveMetaStore from DataStax Enterprise is one of examples.
Author: Artem Aliev <artem.aliev@datastax.com>
Closes #9178 from artem-aliev/SPARK-11208.
| -rw-r--r-- | sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala index 61f611638f..c7460d46b6 100644 --- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala +++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala @@ -725,7 +725,8 @@ private[hive] object HiveContext { // We have to mask all properties in hive-site.xml that relates to metastore data source // as we used a local metastore here. HiveConf.ConfVars.values().foreach { confvar => - if (confvar.varname.contains("datanucleus") || confvar.varname.contains("jdo")) { + if (confvar.varname.contains("datanucleus") || confvar.varname.contains("jdo") + || confvar.varname.contains("hive.metastore.rawstore.impl")) { propMap.put(confvar.varname, confvar.getDefaultExpr()) } } |