diff options
| author | Yijie Shen <henry.yijieshen@gmail.com> | 2015-09-18 13:20:13 -0700 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2015-09-18 13:20:13 -0700 |
| commit | c6f8135ee52202bd86adb090ab631e80330ea4df (patch) | |
| tree | 3e29ff33c4d57bf44595961b8f28bdb411544919 /project/MimaExcludes.scala | |
| parent | 00a2911c5bea67a1a4796fb1d6fd5d0a8ee79001 (diff) | |
| download | spark-c6f8135ee52202bd86adb090ab631e80330ea4df.tar.gz spark-c6f8135ee52202bd86adb090ab631e80330ea4df.tar.bz2 spark-c6f8135ee52202bd86adb090ab631e80330ea4df.zip | |
[SPARK-10539] [SQL] Project should not be pushed down through Intersect or Except #8742
Intersect and Except are both set operators and they use the all the columns to compare equality between rows. When pushing their Project parent down, the relations they based on would change, therefore not an equivalent transformation.
JIRA: https://issues.apache.org/jira/browse/SPARK-10539
I added some comments based on the fix of https://github.com/apache/spark/pull/8742.
Author: Yijie Shen <henry.yijieshen@gmail.com>
Author: Yin Huai <yhuai@databricks.com>
Closes #8823 from yhuai/fix_set_optimization.
Diffstat (limited to 'project/MimaExcludes.scala')
0 files changed, 0 insertions, 0 deletions