diff options
| author | Cheng Lian <lian@databricks.com> | 2016-02-25 20:43:03 +0800 |
|---|---|---|
| committer | Wenchen Fan <wenchen@databricks.com> | 2016-02-25 20:43:03 +0800 |
| commit | 3fa6491be66dad690ca5329dd32e7c82037ae8c1 (patch) | |
| tree | e60e665f5bf5f90ecd0b11a6ca01629f60a93bdc /mllib/src | |
| parent | 2e44031fafdb8cf486573b98e4faa6b31ffb90a4 (diff) | |
| download | spark-3fa6491be66dad690ca5329dd32e7c82037ae8c1.tar.gz spark-3fa6491be66dad690ca5329dd32e7c82037ae8c1.tar.bz2 spark-3fa6491be66dad690ca5329dd32e7c82037ae8c1.zip | |
[SPARK-13473][SQL] Don't push predicate through project with nondeterministic field(s)
## What changes were proposed in this pull request?
Predicates shouldn't be pushed through project with nondeterministic field(s).
See https://github.com/graphframes/graphframes/pull/23 and SPARK-13473 for more details.
This PR targets master, branch-1.6, and branch-1.5.
## How was this patch tested?
A test case is added in `FilterPushdownSuite`. It constructs a query plan where a filter is over a project with a nondeterministic field. Optimized query plan shouldn't change in this case.
Author: Cheng Lian <lian@databricks.com>
Closes #11348 from liancheng/spark-13473-no-ppd-through-nondeterministic-project-field.
Diffstat (limited to 'mllib/src')
0 files changed, 0 insertions, 0 deletions