diff options
author | Takeshi YAMAMURO <linguin.m.s@gmail.com> | 2015-12-21 14:02:40 -0800 |
---|---|---|
committer | Andrew Or <andrew@databricks.com> | 2015-12-21 14:03:23 -0800 |
commit | 935f46630685306edbdec91f71710703317fe129 (patch) | |
tree | 7f87dfc225dd5ae8070162b61b2f6d1a6fcd9c4b /graphx/data | |
parent | 4883a5087d481d4de5d3beabbd709853de01399a (diff) | |
download | spark-935f46630685306edbdec91f71710703317fe129.tar.gz spark-935f46630685306edbdec91f71710703317fe129.tar.bz2 spark-935f46630685306edbdec91f71710703317fe129.zip |
[SPARK-12392][CORE] Optimize a location order of broadcast blocks by considering preferred local hosts
When multiple workers exist in a host, we can bypass unnecessary remote access for broadcasts; block managers fetch broadcast blocks from the same host instead of remote hosts.
Author: Takeshi YAMAMURO <linguin.m.s@gmail.com>
Closes #10346 from maropu/OptimizeBlockLocationOrder.
Diffstat (limited to 'graphx/data')
0 files changed, 0 insertions, 0 deletions