diff options
| author | zsxwing <zsxwing@gmail.com> | 2015-05-16 00:44:29 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-05-16 00:44:29 -0700 |
| commit | 47e7ffe36b8a8a246fe9af522aff480d19c0c8a6 (patch) | |
| tree | 8cfa6ec81fbd0f72e5c9bf74e8b1be0b5217b150 /pom.xml | |
| parent | 0ac8b01a07840f199bbc79fb845762284aead6de (diff) | |
| download | spark-47e7ffe36b8a8a246fe9af522aff480d19c0c8a6.tar.gz spark-47e7ffe36b8a8a246fe9af522aff480d19c0c8a6.tar.bz2 spark-47e7ffe36b8a8a246fe9af522aff480d19c0c8a6.zip | |
[SPARK-7655][Core][SQL] Remove 'scala.concurrent.ExecutionContext.Implicits.global' in 'ask' and 'BroadcastHashJoin'
Because both `AkkaRpcEndpointRef.ask` and `BroadcastHashJoin` uses `scala.concurrent.ExecutionContext.Implicits.global`. However, because the tasks in `BroadcastHashJoin` are usually long-running tasks, which will occupy all threads in `global`. Then `ask` cannot get a chance to process the replies.
For `ask`, actually the tasks are very simple, so we can use `MoreExecutors.sameThreadExecutor()`. For `BroadcastHashJoin`, it's better to use `ThreadUtils.newDaemonCachedThreadPool`.
Author: zsxwing <zsxwing@gmail.com>
Closes #6200 from zsxwing/SPARK-7655-2 and squashes the following commits:
cfdc605 [zsxwing] Remove redundant imort and minor doc fix
cf83153 [zsxwing] Add "sameThread" and "newDaemonCachedThreadPool with maxThreadNumber" to ThreadUtils
08ad0ee [zsxwing] Remove 'scala.concurrent.ExecutionContext.Implicits.global' in 'ask' and 'BroadcastHashJoin'
Diffstat (limited to 'pom.xml')
0 files changed, 0 insertions, 0 deletions