diff options
| author | Shixiong Zhu <shixiong@databricks.com> | 2016-02-26 15:11:57 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2016-02-26 15:11:57 -0800 |
| commit | ad615291fe76580ee59e3f48f4efe4627a01409d (patch) | |
| tree | e305d197d11ad4f9bea43cb79cf2fd5f641f6e1f /make-distribution.sh | |
| parent | 1e5fcdf96c0176a11e5f425ba539b6ed629281db (diff) | |
| download | spark-ad615291fe76580ee59e3f48f4efe4627a01409d.tar.gz spark-ad615291fe76580ee59e3f48f4efe4627a01409d.tar.bz2 spark-ad615291fe76580ee59e3f48f4efe4627a01409d.zip | |
[SPARK-13519][CORE] Driver should tell Executor to stop itself when cleaning executor's state
## What changes were proposed in this pull request?
When the driver removes an executor's state, the connection between the driver and the executor may be still alive so that the executor cannot exit automatically (E.g., Master will send RemoveExecutor when a work is lost but the executor is still alive), so the driver should try to tell the executor to stop itself. Otherwise, we will leak an executor.
This PR modified the driver to send `StopExecutor` to the executor when it's removed.
## How was this patch tested?
manual test: increase the worker heartbeat interval to force it's always timeout and the leak executors are gone.
Author: Shixiong Zhu <shixiong@databricks.com>
Closes #11399 from zsxwing/SPARK-13519.
Diffstat (limited to 'make-distribution.sh')
0 files changed, 0 insertions, 0 deletions