diff options
| author | hyukjinkwon <gurwls223@gmail.com> | 2015-08-13 16:07:03 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-08-13 16:07:03 -0700 |
| commit | c2520f501a200cf794bbe5dc9c385100f518d020 (patch) | |
| tree | d269779a4a034f633c048aa4cef01e4f729fd125 | |
| parent | a8d2f4c5f92210a09c846711bd7cc89a43e2edd2 (diff) | |
| download | spark-c2520f501a200cf794bbe5dc9c385100f518d020.tar.gz spark-c2520f501a200cf794bbe5dc9c385100f518d020.tar.bz2 spark-c2520f501a200cf794bbe5dc9c385100f518d020.zip | |
[SPARK-9935] [SQL] EqualNotNull not processed in ORC
https://issues.apache.org/jira/browse/SPARK-9935
Author: hyukjinkwon <gurwls223@gmail.com>
Closes #8163 from HyukjinKwon/master.
| -rw-r--r-- | sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala index 86142e5d66..b3d9f7f71a 100644 --- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala +++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala @@ -107,6 +107,11 @@ private[orc] object OrcFilters extends Logging { .filter(isSearchableLiteral) .map(builder.equals(attribute, _)) + case EqualNullSafe(attribute, value) => + Option(value) + .filter(isSearchableLiteral) + .map(builder.nullSafeEquals(attribute, _)) + case LessThan(attribute, value) => Option(value) .filter(isSearchableLiteral) |