diff options
| author | Shixiong Zhu <shixiong@databricks.com> | 2016-12-25 23:48:14 -0800 |
|---|---|---|
| committer | Shixiong Zhu <shixiong@databricks.com> | 2016-12-25 23:48:14 -0800 |
| commit | 7026ee23e0a684e13f9d7dfbb8f85e810106d022 (patch) | |
| tree | 97a43e03d3e9ac291b9be0ea2b50158fb7f93ae7 /sql/hive/src/test/scala/org | |
| parent | d6cbec7598b7aea33f588849e6e2e324b8820340 (diff) | |
| download | spark-7026ee23e0a684e13f9d7dfbb8f85e810106d022.tar.gz spark-7026ee23e0a684e13f9d7dfbb8f85e810106d022.tar.bz2 spark-7026ee23e0a684e13f9d7dfbb8f85e810106d022.zip | |
[SPARK-17755][CORE] Use workerRef to send RegisterWorkerResponse to avoid the race condition
## What changes were proposed in this pull request?
The root cause of this issue is that RegisterWorkerResponse and LaunchExecutor are sent via two different channels (TCP connections) and their order is not guaranteed.
This PR changes the master and worker codes to use `workerRef` to send RegisterWorkerResponse, so that RegisterWorkerResponse and LaunchExecutor are sent via the same connection. Hence `LaunchExecutor` will always be after `RegisterWorkerResponse` and never be ignored.
## How was this patch tested?
Jenkins
Author: Shixiong Zhu <shixiong@databricks.com>
Closes #16345 from zsxwing/SPARK-17755.
Diffstat (limited to 'sql/hive/src/test/scala/org')
0 files changed, 0 insertions, 0 deletions