diff options
author | Reynold Xin <rxin@apache.org> | 2014-09-01 20:32:31 -0700 |
---|---|---|
committer | Reynold Xin <rxin@apache.org> | 2014-09-01 20:32:31 -0700 |
commit | db160676c56de54efc4d42c6466847c2c3b6a963 (patch) | |
tree | 5988039eb8777d8e382a10b3bd023ce41abdb0c1 /ec2 | |
parent | 1f98add92675eb34c80be9bd7d10ea4608a9a6c2 (diff) | |
download | spark-db160676c56de54efc4d42c6466847c2c3b6a963.tar.gz spark-db160676c56de54efc4d42c6466847c2c3b6a963.tar.bz2 spark-db160676c56de54efc4d42c6466847c2c3b6a963.zip |
[SPARK-3135] Avoid extra mem copy in TorrentBroadcast via ByteArrayChunkOutputStream
This also enables supporting broadcast variables larger than 2G.
Author: Reynold Xin <rxin@apache.org>
Closes #2054 from rxin/ByteArrayChunkOutputStream and squashes the following commits:
618d9c8 [Reynold Xin] Code review.
93f5a51 [Reynold Xin] Added comments.
ee88e73 [Reynold Xin] to -> until
bbd1cb1 [Reynold Xin] Renamed a variable.
36f4d01 [Reynold Xin] Sort imports.
8f1a8eb [Reynold Xin] [SPARK-3135] Created ByteArrayChunkOutputStream and used it to avoid memory copy in TorrentBroadcast.
Diffstat (limited to 'ec2')
0 files changed, 0 insertions, 0 deletions