diff options
| author | Matei Zaharia <matei@eecs.berkeley.edu> | 2012-10-06 20:07:10 -0700 |
|---|---|---|
| committer | Matei Zaharia <matei@eecs.berkeley.edu> | 2012-10-06 20:07:10 -0700 |
| commit | dc28a3ac0a052f7327d03de76c3b153cda2b616a (patch) | |
| tree | 953ac4550c3e49b6e75772da76186d714b2caeaa /sbt | |
| parent | 9a3b3f32a3ccb849293180a899377e8468f7544a (diff) | |
| download | spark-dc28a3ac0a052f7327d03de76c3b153cda2b616a.tar.gz spark-dc28a3ac0a052f7327d03de76c3b153cda2b616a.tar.bz2 spark-dc28a3ac0a052f7327d03de76c3b153cda2b616a.zip | |
Modified shuffle to limit the maximum outstanding data size in bytes,
instead of the maximum number of outstanding fetches. This should make
it faster when there are many small map output files, as well as more
robust to overallocating memory on large map outputs.
Diffstat (limited to 'sbt')
0 files changed, 0 insertions, 0 deletions