diff options
author | Yanbo Liang <ybliang8@gmail.com> | 2015-10-27 11:28:59 +0100 |
---|---|---|
committer | Michael Armbrust <michael@databricks.com> | 2015-10-27 11:28:59 +0100 |
commit | 360ed832f5213b805ac28cf1d2828be09480f2d6 (patch) | |
tree | 6375913415e936a7a847522fa03a27d8be94f312 /licenses | |
parent | 958a0ec8fa58ff091f595db2b574a7aa3ff41253 (diff) | |
download | spark-360ed832f5213b805ac28cf1d2828be09480f2d6.tar.gz spark-360ed832f5213b805ac28cf1d2828be09480f2d6.tar.bz2 spark-360ed832f5213b805ac28cf1d2828be09480f2d6.zip |
[SPARK-11303][SQL] filter should not be pushed down into sample
When sampling and then filtering DataFrame, the SQL Optimizer will push down filter into sample and produce wrong result. This is due to the sampler is calculated based on the original scope rather than the scope after filtering.
Author: Yanbo Liang <ybliang8@gmail.com>
Closes #9294 from yanboliang/spark-11303.
Diffstat (limited to 'licenses')
0 files changed, 0 insertions, 0 deletions