diff options
| author | Reynold Xin <rxin@apache.org> | 2014-08-05 16:24:50 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2014-08-05 16:24:50 -0700 |
| commit | acff9a7f13b98f10a08aea1d11cfa685c3419367 (patch) | |
| tree | 8c0226b6eb12d4e480a240686f33e9b0d88d3361 /python/pyspark/mllib/classification.py | |
| parent | cc491f69cd239ae7572f1f5f55a2452f7f417dc1 (diff) | |
| download | spark-acff9a7f13b98f10a08aea1d11cfa685c3419367.tar.gz spark-acff9a7f13b98f10a08aea1d11cfa685c3419367.tar.bz2 spark-acff9a7f13b98f10a08aea1d11cfa685c3419367.zip | |
[SPARK-2503] Lower shuffle output buffer (spark.shuffle.file.buffer.kb) to 32KB.
This can substantially reduce memory usage during shuffle.
Author: Reynold Xin <rxin@apache.org>
Closes #1781 from rxin/SPARK-2503-spark.shuffle.file.buffer.kb and squashes the following commits:
104b8d8 [Reynold Xin] [SPARK-2503] Lower shuffle output buffer (spark.shuffle.file.buffer.kb) to 32KB.
Diffstat (limited to 'python/pyspark/mllib/classification.py')
0 files changed, 0 insertions, 0 deletions