diff options
author | Takeshi YAMAMURO <linguin.m.s@gmail.com> | 2016-06-01 22:23:00 -0700 |
---|---|---|
committer | Cheng Lian <lian@databricks.com> | 2016-06-01 22:23:00 -0700 |
commit | 5eea332307cbed5fc44427959f070afc16a12c02 (patch) | |
tree | 8f2cc80645a769fa7908615da3b5c590af8eeab7 /docs/streaming-programming-guide.md | |
parent | 8288e16a5a5a12a45207c13a1341c707c6b4b940 (diff) | |
download | spark-5eea332307cbed5fc44427959f070afc16a12c02.tar.gz spark-5eea332307cbed5fc44427959f070afc16a12c02.tar.bz2 spark-5eea332307cbed5fc44427959f070afc16a12c02.zip |
[SPARK-13484][SQL] Prevent illegal NULL propagation when filtering outer-join results
## What changes were proposed in this pull request?
This PR add a rule at the end of analyzer to correct nullable fields of attributes in a logical plan by using nullable fields of the corresponding attributes in its children logical plans (these plans generate the input rows).
This is another approach for addressing SPARK-13484 (the first approach is https://github.com/apache/spark/pull/11371).
Close #113711
Author: Takeshi YAMAMURO <linguin.m.s@gmail.com>
Author: Yin Huai <yhuai@databricks.com>
Closes #13290 from yhuai/SPARK-13484.
Diffstat (limited to 'docs/streaming-programming-guide.md')
0 files changed, 0 insertions, 0 deletions