diff options
| author | Patrick Wendell <pwendell@gmail.com> | 2014-01-13 11:30:09 -0800 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-01-13 12:21:39 -0800 |
| commit | 5d61e051c2ad5955f0101de6f0ecdf5d243e4f5e (patch) | |
| tree | aafb1bb428b084228edc90962e1247edb4ae3255 /docker/README.md | |
| parent | e6ed13f255d70de422711b979447690cdab7423b (diff) | |
| download | spark-5d61e051c2ad5955f0101de6f0ecdf5d243e4f5e.tar.gz spark-5d61e051c2ad5955f0101de6f0ecdf5d243e4f5e.tar.bz2 spark-5d61e051c2ad5955f0101de6f0ecdf5d243e4f5e.zip | |
Improvements to external sorting
1. Adds the option of compressing outputs.
2. Adds batching to the serialization to prevent OOM on the read side.
3. Slight renaming of config options.
4. Use Spark's buffer size for reads in addition to writes.
Diffstat (limited to 'docker/README.md')
0 files changed, 0 insertions, 0 deletions