diff options
| author | Wenchen Fan <wenchen@databricks.com> | 2016-04-07 17:23:34 -0700 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2016-04-07 17:23:34 -0700 |
| commit | 49fb237081bbca0d811aa48aa06f4728fea62781 (patch) | |
| tree | 674f92f37feb32ef62c2905169d9c435ad337500 /conf | |
| parent | ae1db91d158d1ae62a0ab7ea74467679ca050101 (diff) | |
| download | spark-49fb237081bbca0d811aa48aa06f4728fea62781.tar.gz spark-49fb237081bbca0d811aa48aa06f4728fea62781.tar.bz2 spark-49fb237081bbca0d811aa48aa06f4728fea62781.zip | |
[SPARK-14270][SQL] whole stage codegen support for typed filter
## What changes were proposed in this pull request?
We implement typed filter by `MapPartitions`, which doesn't work well with whole stage codegen. This PR use `Filter` to implement typed filter and we can get the whole stage codegen support for free.
This PR also introduced `DeserializeToObject` and `SerializeFromObject`, to seperate serialization logic from object operator, so that it's eaiser to write optimization rules for adjacent object operators.
## How was this patch tested?
existing tests.
Author: Wenchen Fan <wenchen@databricks.com>
Closes #12061 from cloud-fan/whole-stage-codegen.
Diffstat (limited to 'conf')
0 files changed, 0 insertions, 0 deletions