diff options
| author | Cheng Lian <lian.cs.zju@gmail.com> | 2014-06-25 18:41:47 -0700 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2014-06-25 18:41:58 -0700 |
| commit | 5869f8bf13de39a098e4d386658b178bc1f12563 (patch) | |
| tree | 759cb76b850bc0887ed0a734afcc30904d38fee0 /sql/hive | |
| parent | abb62f0b98f0be77cb509cd0513faa8e9393bfff (diff) | |
| download | spark-5869f8bf13de39a098e4d386658b178bc1f12563.tar.gz spark-5869f8bf13de39a098e4d386658b178bc1f12563.tar.bz2 spark-5869f8bf13de39a098e4d386658b178bc1f12563.zip | |
[SPARK-2283][SQL] Reset test environment before running PruningSuite
JIRA issue: [SPARK-2283](https://issues.apache.org/jira/browse/SPARK-2283)
If `PruningSuite` is run right after `HiveCompatibilitySuite`, the first test case fails because `srcpart` table is cached in-memory by `HiveCompatibilitySuite`, but column pruning is not implemented for `InMemoryColumnarTableScan` operator yet.
Author: Cheng Lian <lian.cs.zju@gmail.com>
Closes #1221 from liancheng/spark-2283 and squashes the following commits:
dc0b663 [Cheng Lian] SPARK-2283: reset test environment before running PruningSuite
(cherry picked from commit 7f196b009d26d4aed403b3c694f8b603601718e3)
Signed-off-by: Michael Armbrust <michael@databricks.com>
Diffstat (limited to 'sql/hive')
| -rw-r--r-- | sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PruningSuite.scala | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PruningSuite.scala b/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PruningSuite.scala index 34434449a0..4d7c84f443 100644 --- a/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PruningSuite.scala +++ b/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PruningSuite.scala @@ -26,6 +26,11 @@ import scala.collection.JavaConversions._ * A set of test cases that validate partition and column pruning. */ class PruningSuite extends HiveComparisonTest { + // Column/partition pruning is not implemented for `InMemoryColumnarTableScan` yet, need to reset + // the environment to ensure all referenced tables in this suites are not cached in-memory. + // Refer to https://issues.apache.org/jira/browse/SPARK-2283 for details. + TestHive.reset() + // Column pruning tests createPruningTest("Column pruning - with partitioned table", |