diff options
| author | Shubham Chopra <schopra31@bloomberg.net> | 2016-09-30 18:24:39 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-09-30 18:24:39 -0700 |
| commit | a26afd52198523dbd51dc94053424494638c7de5 (patch) | |
| tree | d86b827d9c5da5246597479d9428f9c3b5dea657 /external | |
| parent | 81455a9cd963098613bad10182e3fafc83a6e352 (diff) | |
| download | spark-a26afd52198523dbd51dc94053424494638c7de5.tar.gz spark-a26afd52198523dbd51dc94053424494638c7de5.tar.bz2 spark-a26afd52198523dbd51dc94053424494638c7de5.zip | |
[SPARK-15353][CORE] Making peer selection for block replication pluggable
## What changes were proposed in this pull request?
This PR makes block replication strategies pluggable. It provides two trait that can be implemented, one that maps a host to its topology and is used in the master, and the second that helps prioritize a list of peers for block replication and would run in the executors.
This patch contains default implementations of these traits that make sure current Spark behavior is unchanged.
## How was this patch tested?
This patch should not change Spark behavior in any way, and was tested with unit tests for storage.
Author: Shubham Chopra <schopra31@bloomberg.net>
Closes #13152 from shubhamchopra/RackAwareBlockReplication.
Diffstat (limited to 'external')
0 files changed, 0 insertions, 0 deletions