diff options
| author | Jacky Li <jacky.likun@huawei.com> | 2014-12-16 15:34:59 -0800 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2014-12-16 15:34:59 -0800 |
| commit | fa66ef6c97e87c9255b67b03836a4ba50598ebae (patch) | |
| tree | 22c45c07db924fa4b53b8b97917d5e06499322a6 /dev/create-release | |
| parent | a66c23e134a0b1ad9540626fb7436d70d577d929 (diff) | |
| download | spark-fa66ef6c97e87c9255b67b03836a4ba50598ebae.tar.gz spark-fa66ef6c97e87c9255b67b03836a4ba50598ebae.tar.bz2 spark-fa66ef6c97e87c9255b67b03836a4ba50598ebae.zip | |
[SPARK-4269][SQL] make wait time configurable in BroadcastHashJoin
In BroadcastHashJoin, currently it is using a hard coded value (5 minutes) to wait for the execution and broadcast of the small table.
In my opinion, it should be a configurable value since broadcast may exceed 5 minutes in some case, like in a busy/congested network environment.
Author: Jacky Li <jacky.likun@huawei.com>
Closes #3133 from jackylk/timeout-config and squashes the following commits:
733ac08 [Jacky Li] add spark.sql.broadcastTimeout in SQLConf.scala
557acd4 [Jacky Li] switch to sqlContext.getConf
81a5e20 [Jacky Li] make wait time configurable in BroadcastHashJoin
Diffstat (limited to 'dev/create-release')
0 files changed, 0 insertions, 0 deletions