diff options
| author | root <root@iZbp1gsnrlfzjxh82cz80vZ.(none)> | 2016-12-16 10:16:57 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2016-12-16 10:16:57 +0000 |
| commit | 53ab8fb34682203d2138567c0a7deff34e0da9c5 (patch) | |
| tree | 0cf517b9233a447a7d95a6315b5ad00a34fb4cee /sql | |
| parent | d7f3058e17571d76a8b4c8932de6de81ce8d2e78 (diff) | |
| download | spark-53ab8fb34682203d2138567c0a7deff34e0da9c5.tar.gz spark-53ab8fb34682203d2138567c0a7deff34e0da9c5.tar.bz2 spark-53ab8fb34682203d2138567c0a7deff34e0da9c5.zip | |
[SPARK-18742][CORE] Clarify that user-defined BroadcastFactory is not supported
## What changes were proposed in this pull request?
After SPARK-12588 Remove HTTPBroadcast [1], the one and only implementation of BroadcastFactory is TorrentBroadcastFactory and the spark.broadcast.factory conf has removed.
however the scaladoc says [2]:
/**
* An interface for all the broadcast implementations in Spark (to allow
* multiple broadcast implementations). SparkContext uses a user-specified
* BroadcastFactory implementation to instantiate a particular broadcast for the
* entire Spark job.
*/
so we should modify the comment that SparkContext will not use a user-specified BroadcastFactory implementation
[1] https://issues.apache.org/jira/browse/SPARK-12588
[2] https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/broadcast/BroadcastFactory.scala#L25-L30
## How was this patch tested?
unit test added
Author: root <root@iZbp1gsnrlfzjxh82cz80vZ.(none)>
Author: windpiger <songjun@outlook.com>
Closes #16173 from windpiger/addBroadFactoryConf.
Diffstat (limited to 'sql')
0 files changed, 0 insertions, 0 deletions