diff options
| author | Patrick Wendell <pwendell@gmail.com> | 2014-01-13 22:56:12 -0800 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-01-13 22:56:12 -0800 |
| commit | 945fe7a37ea3189b5a9f8a74e5c2fa9c1088ebfc (patch) | |
| tree | d8a9f245bb3febc56fc8e0f6eceeec5296711cea /project/SparkBuild.scala | |
| parent | 68641bce612d9a4c4adc34d4dd9cab6735f28335 (diff) | |
| parent | d4cd5debf4ac11884e4e703f482ffc17427e277f (diff) | |
| download | spark-945fe7a37ea3189b5a9f8a74e5c2fa9c1088ebfc.tar.gz spark-945fe7a37ea3189b5a9f8a74e5c2fa9c1088ebfc.tar.bz2 spark-945fe7a37ea3189b5a9f8a74e5c2fa9c1088ebfc.zip | |
Merge pull request #408 from pwendell/external-serializers
Improvements to external sorting
1. Adds the option of compressing outputs.
2. Adds batching to the serialization to prevent OOM on the read side.
3. Slight renaming of config options.
4. Use Spark's buffer size for reads in addition to writes.
Diffstat (limited to 'project/SparkBuild.scala')
0 files changed, 0 insertions, 0 deletions