diff options
| author | hyukjinkwon <gurwls223@gmail.com> | 2015-12-16 13:24:49 -0800 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2015-12-16 13:24:49 -0800 |
| commit | 9657ee87888422c5596987fe760b49117a0ea4e2 (patch) | |
| tree | d4f675ade07834b509a69881e4184f5a21383b15 /python/pyspark/ml/tuning.py | |
| parent | edf65cd961b913ef54104770630a50fd4b120b4b (diff) | |
| download | spark-9657ee87888422c5596987fe760b49117a0ea4e2.tar.gz spark-9657ee87888422c5596987fe760b49117a0ea4e2.tar.bz2 spark-9657ee87888422c5596987fe760b49117a0ea4e2.zip | |
[SPARK-11677][SQL] ORC filter tests all pass if filters are actually not pushed down.
Currently ORC filters are not tested properly. All the tests pass even if the filters are not pushed down or disabled. In this PR, I add some logics for this.
Since ORC does not filter record by record fully, this checks the count of the result and if it contains the expected values.
Author: hyukjinkwon <gurwls223@gmail.com>
Closes #9687 from HyukjinKwon/SPARK-11677.
Diffstat (limited to 'python/pyspark/ml/tuning.py')
0 files changed, 0 insertions, 0 deletions