diff options
author | Wenchen Fan <wenchen@databricks.com> | 2017-03-10 16:14:22 -0800 |
---|---|---|
committer | Wenchen Fan <wenchen@databricks.com> | 2017-03-10 16:14:22 -0800 |
commit | fb9beda54622e0c3190c6504fc468fa4e50eeb45 (patch) | |
tree | 90a8303e9ac42b1cfe6a7046b27d4ef6c6e07895 /docs/structured-streaming-programming-guide.md | |
parent | ffee4f1cefb0dfd8d9145ee3be82c6f7b799870b (diff) | |
download | spark-fb9beda54622e0c3190c6504fc468fa4e50eeb45.tar.gz spark-fb9beda54622e0c3190c6504fc468fa4e50eeb45.tar.bz2 spark-fb9beda54622e0c3190c6504fc468fa4e50eeb45.zip |
[SPARK-19893][SQL] should not run DataFrame set oprations with map type
## What changes were proposed in this pull request?
In spark SQL, map type can't be used in equality test/comparison, and `Intersect`/`Except`/`Distinct` do need equality test for all columns, we should not allow map type in `Intersect`/`Except`/`Distinct`.
## How was this patch tested?
new regression test
Author: Wenchen Fan <wenchen@databricks.com>
Closes #17236 from cloud-fan/map.
Diffstat (limited to 'docs/structured-streaming-programming-guide.md')
0 files changed, 0 insertions, 0 deletions