aboutsummaryrefslogtreecommitdiff
path: root/sql/core
diff options
context:
space:
mode:
authorWenchen Fan <wenchen@databricks.com>2016-08-17 09:31:22 -0700
committerYin Huai <yhuai@databricks.com>2016-08-17 09:31:22 -0700
commit928ca1c6d12b23d84f9b6205e22d2e756311f072 (patch)
treedc36df4d96d400ff3e8d76bc29942a180b4860d8 /sql/core
parent0b0c8b95e3594db36d87ef0e59a30eefe8508ac1 (diff)
downloadspark-928ca1c6d12b23d84f9b6205e22d2e756311f072.tar.gz
spark-928ca1c6d12b23d84f9b6205e22d2e756311f072.tar.bz2
spark-928ca1c6d12b23d84f9b6205e22d2e756311f072.zip
[SPARK-17102][SQL] bypass UserDefinedGenerator for json format check
## What changes were proposed in this pull request? We use reflection to convert `TreeNode` to json string, and currently don't support arbitrary object. `UserDefinedGenerator` takes a function object, so we should skip json format test for it, or the tests can be flacky, e.g. `DataFrameSuite.simple explode`, this test always fail with scala 2.10(branch 1.6 builds with scala 2.10 by default), but pass with scala 2.11(master branch builds with scala 2.11 by default). ## How was this patch tested? N/A Author: Wenchen Fan <wenchen@databricks.com> Closes #14679 from cloud-fan/json.
Diffstat (limited to 'sql/core')
-rw-r--r--sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala3
1 files changed, 2 insertions, 1 deletions
diff --git a/sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala b/sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala
index cff9d22d08..484e438033 100644
--- a/sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala
+++ b/sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala
@@ -249,9 +249,10 @@ abstract class QueryTest extends PlanTest {
}
p
}.transformAllExpressions {
- case a: ImperativeAggregate => return
+ case _: ImperativeAggregate => return
case _: TypedAggregateExpression => return
case Literal(_, _: ObjectType) => return
+ case _: UserDefinedGenerator => return
}
// bypass hive tests before we fix all corner cases in hive module.