diff options
author | codlife <1004910847@qq.com> | 2016-09-12 12:10:46 +0100 |
---|---|---|
committer | Sean Owen <sowen@cloudera.com> | 2016-09-12 12:10:46 +0100 |
commit | 4efcdb7feae24e41d8120b59430f8b77cc2106a6 (patch) | |
tree | 83178b915686b487c9c05dd915cb096c0b1a26f6 /dev | |
parent | cc87280fcd065b01667ca7a59a1a32c7ab757355 (diff) | |
download | spark-4efcdb7feae24e41d8120b59430f8b77cc2106a6.tar.gz spark-4efcdb7feae24e41d8120b59430f8b77cc2106a6.tar.bz2 spark-4efcdb7feae24e41d8120b59430f8b77cc2106a6.zip |
[SPARK-17447] Performance improvement in Partitioner.defaultPartitioner without sortBy
## What changes were proposed in this pull request?
if there are many rdds in some situations,the sort will loss he performance servely,actually we needn't sort the rdds , we can just scan the rdds one time to gain the same goal.
## How was this patch tested?
manual tests
Author: codlife <1004910847@qq.com>
Closes #15039 from codlife/master.
Diffstat (limited to 'dev')
0 files changed, 0 insertions, 0 deletions