diff options
| author | hyukjinkwon <gurwls223@gmail.com> | 2015-12-09 15:15:30 +0800 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2015-12-09 15:15:30 +0800 |
| commit | f6883bb7afa7d5df480e1c2b3db6cb77198550be (patch) | |
| tree | 3249b4391dd2eb7a546820b21117fb9961829098 /tools/pom.xml | |
| parent | 3934562d34bbe08d91c54b4bbee27870e93d7571 (diff) | |
| download | spark-f6883bb7afa7d5df480e1c2b3db6cb77198550be.tar.gz spark-f6883bb7afa7d5df480e1c2b3db6cb77198550be.tar.bz2 spark-f6883bb7afa7d5df480e1c2b3db6cb77198550be.zip | |
[SPARK-11676][SQL] Parquet filter tests all pass if filters are not really pushed down
Currently Parquet predicate tests all pass even if filters are not pushed down or this is disabled.
In this PR, For checking evaluating filters, Simply it makes the expression from `expression.Filter` and then try to create filters just like Spark does.
For checking the results, this manually accesses to the child rdd (of `expression.Filter`) and produces the results which should be filtered properly, and then compares it to expected values.
Now, if filters are not pushed down or this is disabled, this throws exceptions.
Author: hyukjinkwon <gurwls223@gmail.com>
Closes #9659 from HyukjinKwon/SPARK-11676.
Diffstat (limited to 'tools/pom.xml')
0 files changed, 0 insertions, 0 deletions