diff options
author | Reynold Xin <rxin@databricks.com> | 2016-06-30 19:02:35 -0700 |
---|---|---|
committer | Reynold Xin <rxin@databricks.com> | 2016-06-30 19:02:35 -0700 |
commit | 38f4d6f44eaa03bdc703662e4a7be9c09ba86e16 (patch) | |
tree | 900b3dccac6929d6cb2fd2f0fc10c29a78779024 /python/pyspark | |
parent | 4a981dc870a31d8b90aac5f6cb22884e02f6fbc6 (diff) | |
download | spark-38f4d6f44eaa03bdc703662e4a7be9c09ba86e16.tar.gz spark-38f4d6f44eaa03bdc703662e4a7be9c09ba86e16.tar.bz2 spark-38f4d6f44eaa03bdc703662e4a7be9c09ba86e16.zip |
[SPARK-15954][SQL] Disable loading test tables in Python tests
## What changes were proposed in this pull request?
This patch introduces a flag to disable loading test tables in TestHiveSparkSession and disables that in Python. This fixes an issue in which python/run-tests would fail due to failure to load test tables.
Note that these test tables are not used outside of HiveCompatibilitySuite. In the long run we should probably decouple the loading of test tables from the test Hive setup.
## How was this patch tested?
This is a test only change.
Author: Reynold Xin <rxin@databricks.com>
Closes #14005 from rxin/SPARK-15954.
Diffstat (limited to 'python/pyspark')
-rw-r--r-- | python/pyspark/sql/context.py | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/python/pyspark/sql/context.py b/python/pyspark/sql/context.py index 8c984b36b7..4cfdf799f6 100644 --- a/python/pyspark/sql/context.py +++ b/python/pyspark/sql/context.py @@ -492,7 +492,7 @@ class HiveContext(SQLContext): confusing error messages. """ jsc = sparkContext._jsc.sc() - jtestHive = sparkContext._jvm.org.apache.spark.sql.hive.test.TestHiveContext(jsc) + jtestHive = sparkContext._jvm.org.apache.spark.sql.hive.test.TestHiveContext(jsc, False) return cls(sparkContext, jtestHive) def refreshTable(self, tableName): |