diff options
author | Andrew Or <andrew@databricks.com> | 2014-11-19 10:45:42 -0800 |
---|---|---|
committer | Andrew Or <andrew@databricks.com> | 2014-11-19 10:45:42 -0800 |
commit | 16bf5f3d17624db2a96c921fe8a1e153cdafb06c (patch) | |
tree | 0ef8eec61f1dfb376a7505a31fccb1463bb79e24 /README.md | |
parent | e22a75923e508e17b924f341d02cd5cd679210ca (diff) | |
download | spark-16bf5f3d17624db2a96c921fe8a1e153cdafb06c.tar.gz spark-16bf5f3d17624db2a96c921fe8a1e153cdafb06c.tar.bz2 spark-16bf5f3d17624db2a96c921fe8a1e153cdafb06c.zip |
[SPARK-4480] Avoid many small spills in external data structures (1.1)
This is the branch-1.1 version of #3353. This requires a separate PR because the code in master has been refactored a little to eliminate duplicate code. I have tested this on a standalone cluster. The goal is to merge this into 1.1.1.
Author: Andrew Or <andrew@databricks.com>
Closes #3354 from andrewor14/avoid-small-spills-1.1 and squashes the following commits:
f2e552c [Andrew Or] Fix tests
7012595 [Andrew Or] Avoid many small spills
Diffstat (limited to 'README.md')
0 files changed, 0 insertions, 0 deletions