diff options
author | Wenchen Fan <wenchen@databricks.com> | 2016-04-07 17:23:34 -0700 |
---|---|---|
committer | Yin Huai <yhuai@databricks.com> | 2016-04-07 17:23:34 -0700 |
commit | 49fb237081bbca0d811aa48aa06f4728fea62781 (patch) | |
tree | 674f92f37feb32ef62c2905169d9c435ad337500 /sbin/stop-master.sh | |
parent | ae1db91d158d1ae62a0ab7ea74467679ca050101 (diff) | |
download | spark-49fb237081bbca0d811aa48aa06f4728fea62781.tar.gz spark-49fb237081bbca0d811aa48aa06f4728fea62781.tar.bz2 spark-49fb237081bbca0d811aa48aa06f4728fea62781.zip |
[SPARK-14270][SQL] whole stage codegen support for typed filter
## What changes were proposed in this pull request?
We implement typed filter by `MapPartitions`, which doesn't work well with whole stage codegen. This PR use `Filter` to implement typed filter and we can get the whole stage codegen support for free.
This PR also introduced `DeserializeToObject` and `SerializeFromObject`, to seperate serialization logic from object operator, so that it's eaiser to write optimization rules for adjacent object operators.
## How was this patch tested?
existing tests.
Author: Wenchen Fan <wenchen@databricks.com>
Closes #12061 from cloud-fan/whole-stage-codegen.
Diffstat (limited to 'sbin/stop-master.sh')
0 files changed, 0 insertions, 0 deletions