diff options
| author | Shixiong Zhu <shixiong@databricks.com> | 2017-01-18 01:57:12 +0800 |
|---|---|---|
| committer | Wenchen Fan <wenchen@databricks.com> | 2017-01-18 01:57:12 +0800 |
| commit | a83accfcfd6a92afac5040c50577258ab83d10dd (patch) | |
| tree | 123b8b01ad17639c72829d4e75217fa6b414129d /python/pyspark/sql/readwriter.py | |
| parent | 20e6280626fe243b170a2e7c5e018c67f3dac1db (diff) | |
| download | spark-a83accfcfd6a92afac5040c50577258ab83d10dd.tar.gz spark-a83accfcfd6a92afac5040c50577258ab83d10dd.tar.bz2 spark-a83accfcfd6a92afac5040c50577258ab83d10dd.zip | |
[SPARK-19065][SQL] Don't inherit expression id in dropDuplicates
## What changes were proposed in this pull request?
`dropDuplicates` will create an Alias using the same exprId, so `StreamExecution` should also replace Alias if necessary.
## How was this patch tested?
test("SPARK-19065: dropDuplicates should not create expressions using the same id")
Author: Shixiong Zhu <shixiong@databricks.com>
Closes #16564 from zsxwing/SPARK-19065.
Diffstat (limited to 'python/pyspark/sql/readwriter.py')
0 files changed, 0 insertions, 0 deletions