diff options
| author | Davies Liu <davies@databricks.com> | 2016-03-16 21:46:04 -0700 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-03-16 21:46:04 -0700 |
| commit | c100d31ddc6db9c03b7a65a20a7dd56dcdc18baf (patch) | |
| tree | 056ca296a4922ae696ef4b6126329ef77963944e /docs/ml-ensembles.md | |
| parent | 917f4000b418ee0997551d4dfabb369c4e9243a9 (diff) | |
| download | spark-c100d31ddc6db9c03b7a65a20a7dd56dcdc18baf.tar.gz spark-c100d31ddc6db9c03b7a65a20a7dd56dcdc18baf.tar.bz2 spark-c100d31ddc6db9c03b7a65a20a7dd56dcdc18baf.zip | |
[SPARK-13873] [SQL] Avoid copy of UnsafeRow when there is no join in whole stage codegen
## What changes were proposed in this pull request?
We need to copy the UnsafeRow since a Join could produce multiple rows from single input rows. We could avoid that if there is no join (or the join will not produce multiple rows) inside WholeStageCodegen.
Updated the benchmark for `collect`, we could see 20-30% speedup.
## How was this patch tested?
existing unit tests.
Author: Davies Liu <davies@databricks.com>
Closes #11740 from davies/avoid_copy2.
Diffstat (limited to 'docs/ml-ensembles.md')
0 files changed, 0 insertions, 0 deletions