diff options
author | Liang-Chi Hsieh <simonh@tw.ibm.com> | 2016-05-12 10:11:12 -0700 |
---|---|---|
committer | Yin Huai <yhuai@databricks.com> | 2016-05-12 10:11:12 -0700 |
commit | 470de743ecf3617babd86f50ab203e85aa975d69 (patch) | |
tree | 58a87637c705c3c0a8430a49607ec4c603e6dc22 /launcher | |
parent | 5bb62b893bf13973de63ab28571e05501b84bfef (diff) | |
download | spark-470de743ecf3617babd86f50ab203e85aa975d69.tar.gz spark-470de743ecf3617babd86f50ab203e85aa975d69.tar.bz2 spark-470de743ecf3617babd86f50ab203e85aa975d69.zip |
[SPARK-15094][SPARK-14803][SQL] Remove extra Project added in EliminateSerialization
## What changes were proposed in this pull request?
We will eliminate the pair of `DeserializeToObject` and `SerializeFromObject` in `Optimizer` and add extra `Project`. However, when DeserializeToObject's outputObjectType is ObjectType and its cls can't be processed by unsafe project, it will be failed.
To fix it, we can simply remove the extra `Project` and replace the output attribute of `DeserializeToObject` in another rule.
## How was this patch tested?
`DatasetSuite`.
Author: Liang-Chi Hsieh <simonh@tw.ibm.com>
Closes #12926 from viirya/fix-eliminate-serialization-projection.
Diffstat (limited to 'launcher')
0 files changed, 0 insertions, 0 deletions