diff options
author | Reynold Xin <rxin@apache.org> | 2014-07-15 18:47:39 -0700 |
---|---|---|
committer | Reynold Xin <rxin@apache.org> | 2014-07-15 18:47:39 -0700 |
commit | 4576d80a5155c9fbfebe9c36cca06c208bca5bd3 (patch) | |
tree | cdda518b057bb1e0c8770d737fcac25f4b8f1c78 /python | |
parent | c2048a5165b270f5baf2003fdfef7bc6c5875715 (diff) | |
download | spark-4576d80a5155c9fbfebe9c36cca06c208bca5bd3.tar.gz spark-4576d80a5155c9fbfebe9c36cca06c208bca5bd3.tar.bz2 spark-4576d80a5155c9fbfebe9c36cca06c208bca5bd3.zip |
[SPARK-2469] Use Snappy (instead of LZF) for default shuffle compression codec
This reduces shuffle compression memory usage by 3x.
Author: Reynold Xin <rxin@apache.org>
Closes #1415 from rxin/snappy and squashes the following commits:
06c1a01 [Reynold Xin] SPARK-2469: Use Snappy (instead of LZF) for default shuffle compression codec.
Diffstat (limited to 'python')
0 files changed, 0 insertions, 0 deletions