diff options
| author | Mark Hamstra <markhamstra@gmail.com> | 2016-11-29 15:01:12 -0800 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2016-11-29 15:01:12 -0800 |
| commit | f8878a4c6f7c4ebb16e4aef26ad0869ba12eb9fc (patch) | |
| tree | fda5146965a7165fa709a9cb666392fcaf92c1c8 /sql/core/src/test/resources | |
| parent | d57a594b8b4cb1a6942dbd2fd30c3a97e0dd031e (diff) | |
| download | spark-f8878a4c6f7c4ebb16e4aef26ad0869ba12eb9fc.tar.gz spark-f8878a4c6f7c4ebb16e4aef26ad0869ba12eb9fc.tar.bz2 spark-f8878a4c6f7c4ebb16e4aef26ad0869ba12eb9fc.zip | |
[SPARK-18631][SQL] Changed ExchangeCoordinator re-partitioning to avoid more data skew
## What changes were proposed in this pull request?
Re-partitioning logic in ExchangeCoordinator changed so that adding another pre-shuffle partition to the post-shuffle partition will not be done if doing so would cause the size of the post-shuffle partition to exceed the target partition size.
## How was this patch tested?
Existing tests updated to reflect new expectations.
Author: Mark Hamstra <markhamstra@gmail.com>
Closes #16065 from markhamstra/SPARK-17064.
Diffstat (limited to 'sql/core/src/test/resources')
0 files changed, 0 insertions, 0 deletions