diff options
| author | Wenchen Fan <wenchen@databricks.com> | 2016-04-19 10:00:44 -0700 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-04-19 10:00:44 -0700 |
| commit | 9ee95b6eccba41460b79c0aced9d00a39b5ae0c3 (patch) | |
| tree | a82da58486bc31c13fbe7592f91412499ca6d597 /R | |
| parent | 5e360c93bed9d4f9250cf79bbcebd8552557f548 (diff) | |
| download | spark-9ee95b6eccba41460b79c0aced9d00a39b5ae0c3.tar.gz spark-9ee95b6eccba41460b79c0aced9d00a39b5ae0c3.tar.bz2 spark-9ee95b6eccba41460b79c0aced9d00a39b5ae0c3.zip | |
[SPARK-14491] [SQL] refactor object operator framework to make it easy to eliminate serializations
## What changes were proposed in this pull request?
This PR tries to separate the serialization and deserialization logic from object operators, so that it's easier to eliminate unnecessary serializations in optimizer.
Typed aggregate related operators are special, they will deserialize the input row to multiple objects and it's difficult to simply use a deserializer operator to abstract it, so we still mix the deserialization logic there.
## How was this patch tested?
existing tests and new test in `EliminateSerializationSuite`
Author: Wenchen Fan <wenchen@databricks.com>
Closes #12260 from cloud-fan/encoder.
Diffstat (limited to 'R')
0 files changed, 0 insertions, 0 deletions