aboutsummaryrefslogtreecommitdiff
path: root/python/pyspark
diff options
context:
space:
mode:
authorReynold Xin <rxin@databricks.com>2016-06-30 19:02:35 -0700
committerReynold Xin <rxin@databricks.com>2016-06-30 19:02:35 -0700
commit38f4d6f44eaa03bdc703662e4a7be9c09ba86e16 (patch)
tree900b3dccac6929d6cb2fd2f0fc10c29a78779024 /python/pyspark
parent4a981dc870a31d8b90aac5f6cb22884e02f6fbc6 (diff)
downloadspark-38f4d6f44eaa03bdc703662e4a7be9c09ba86e16.tar.gz
spark-38f4d6f44eaa03bdc703662e4a7be9c09ba86e16.tar.bz2
spark-38f4d6f44eaa03bdc703662e4a7be9c09ba86e16.zip
[SPARK-15954][SQL] Disable loading test tables in Python tests
## What changes were proposed in this pull request? This patch introduces a flag to disable loading test tables in TestHiveSparkSession and disables that in Python. This fixes an issue in which python/run-tests would fail due to failure to load test tables. Note that these test tables are not used outside of HiveCompatibilitySuite. In the long run we should probably decouple the loading of test tables from the test Hive setup. ## How was this patch tested? This is a test only change. Author: Reynold Xin <rxin@databricks.com> Closes #14005 from rxin/SPARK-15954.
Diffstat (limited to 'python/pyspark')
-rw-r--r--python/pyspark/sql/context.py2
1 files changed, 1 insertions, 1 deletions
diff --git a/python/pyspark/sql/context.py b/python/pyspark/sql/context.py
index 8c984b36b7..4cfdf799f6 100644
--- a/python/pyspark/sql/context.py
+++ b/python/pyspark/sql/context.py
@@ -492,7 +492,7 @@ class HiveContext(SQLContext):
confusing error messages.
"""
jsc = sparkContext._jsc.sc()
- jtestHive = sparkContext._jvm.org.apache.spark.sql.hive.test.TestHiveContext(jsc)
+ jtestHive = sparkContext._jvm.org.apache.spark.sql.hive.test.TestHiveContext(jsc, False)
return cls(sparkContext, jtestHive)
def refreshTable(self, tableName):