diff options
| author | Koert Kuipers <koert@tresata.com> | 2017-04-19 15:52:47 +0800 |
|---|---|---|
| committer | Wenchen Fan <wenchen@databricks.com> | 2017-04-19 15:52:47 +0800 |
| commit | 608bf30f0b9759fd0b9b9f33766295550996a9eb (patch) | |
| tree | b98d4b1ad4d4205051c0e316bf388914cbe5d7f5 /sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala | |
| parent | 702d85af2df9433254af6fa029683aa19c52a276 (diff) | |
| download | spark-608bf30f0b9759fd0b9b9f33766295550996a9eb.tar.gz spark-608bf30f0b9759fd0b9b9f33766295550996a9eb.tar.bz2 spark-608bf30f0b9759fd0b9b9f33766295550996a9eb.zip | |
[SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE
Avoid necessary execution that can lead to NPE in EliminateOuterJoin and add test in DataFrameSuite to confirm NPE is no longer thrown
## What changes were proposed in this pull request?
Change leftHasNonNullPredicate and rightHasNonNullPredicate to lazy so they are only executed when needed.
## How was this patch tested?
Added test in DataFrameSuite that failed before this fix and now succeeds. Note that a test in catalyst project would be better but i am unsure how to do this.
Please review http://spark.apache.org/contributing.html before opening a pull request.
Author: Koert Kuipers <koert@tresata.com>
Closes #17660 from koertkuipers/feat-catch-npe-in-eliminate-outer-join.
Diffstat (limited to 'sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala')
0 files changed, 0 insertions, 0 deletions