diff options
| author | Sameer Agarwal <sameer@databricks.com> | 2016-03-25 12:57:26 -0700 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-03-25 12:57:26 -0700 |
| commit | afd0debe075e9ea8466e384932a513ef0188273c (patch) | |
| tree | 008fa22edf6907e460920b975aebb0333a5f1f84 /sql/hive | |
| parent | ca003354da5e738e97418efc5af07be071c16d8f (diff) | |
| download | spark-afd0debe075e9ea8466e384932a513ef0188273c.tar.gz spark-afd0debe075e9ea8466e384932a513ef0188273c.tar.bz2 spark-afd0debe075e9ea8466e384932a513ef0188273c.zip | |
[SPARK-14137] [SPARK-14150] [SQL] Infer IsNotNull constraints from non-nullable attributes
## What changes were proposed in this pull request?
This PR adds support for automatically inferring `IsNotNull` constraints from any non-nullable attributes that are part of an operator's output. This also fixes the issue that causes the optimizer to hit the maximum number of iterations for certain queries in https://github.com/apache/spark/pull/11828.
## How was this patch tested?
Unit test in `ConstraintPropagationSuite`
Author: Sameer Agarwal <sameer@databricks.com>
Closes #11953 from sameeragarwal/infer-isnotnull.
Diffstat (limited to 'sql/hive')
| -rw-r--r-- | sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala | 4 |
1 files changed, 1 insertions, 3 deletions
diff --git a/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala b/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala index 8bd731dda2..650797f768 100644 --- a/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala +++ b/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala @@ -341,9 +341,6 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter { "udf_round_3", "view_cast", - // enable this after fixing SPARK-14137 - "union20", - // These tests check the VIEW table definition, but Spark handles CREATE VIEW itself and // generates different View Expanded Text. "alter_view_as_select", @@ -1046,6 +1043,7 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter { "union18", "union19", "union2", + "union20", "union22", "union23", "union24", |