diff options
author | Daoyuan Wang <daoyuan.wang@intel.com> | 2015-07-17 16:45:46 -0700 |
---|---|---|
committer | Michael Armbrust <michael@databricks.com> | 2015-07-17 16:45:46 -0700 |
commit | 1707238601690fd0e8e173e2c47f1b4286644a29 (patch) | |
tree | 5a17ff1d0dd82694aa8e52f32fa21d237a738032 /python/docs/pyspark.ml.rst | |
parent | b13ef7723f254c10c685b93eb8dc08a52527ec73 (diff) | |
download | spark-1707238601690fd0e8e173e2c47f1b4286644a29.tar.gz spark-1707238601690fd0e8e173e2c47f1b4286644a29.tar.bz2 spark-1707238601690fd0e8e173e2c47f1b4286644a29.zip |
[SPARK-7026] [SQL] fix left semi join with equi key and non-equi condition
When the `condition` extracted by `ExtractEquiJoinKeys` contain join Predicate for left semi join, we can not plan it as semiJoin. Such as
SELECT * FROM testData2 x
LEFT SEMI JOIN testData2 y
ON x.b = y.b
AND x.a >= y.a + 2
Condition `x.a >= y.a + 2` can not evaluate on table `x`, so it throw errors
Author: Daoyuan Wang <daoyuan.wang@intel.com>
Closes #5643 from adrian-wang/spark7026 and squashes the following commits:
cc09809 [Daoyuan Wang] refactor semijoin and add plan test
575a7c8 [Daoyuan Wang] fix notserializable
27841de [Daoyuan Wang] fix rebase
10bf124 [Daoyuan Wang] fix style
72baa02 [Daoyuan Wang] fix style
8e0afca [Daoyuan Wang] merge commits for rebase
Diffstat (limited to 'python/docs/pyspark.ml.rst')
0 files changed, 0 insertions, 0 deletions