diff options
author | Mark Hamstra <markhamstra@gmail.com> | 2014-12-03 15:08:01 -0800 |
---|---|---|
committer | Josh Rosen <joshrosen@databricks.com> | 2014-12-03 15:08:01 -0800 |
commit | 96b27855c5f9789d1f15316564a8e0fa2cd5a51b (patch) | |
tree | ae9174d2013f6d83dcc4b38f13a742df482b9fda /bin/spark-submit.cmd | |
parent | 513ef82e85661552e596d0b483b645ac24e86d4d (diff) | |
download | spark-96b27855c5f9789d1f15316564a8e0fa2cd5a51b.tar.gz spark-96b27855c5f9789d1f15316564a8e0fa2cd5a51b.tar.bz2 spark-96b27855c5f9789d1f15316564a8e0fa2cd5a51b.zip |
[SPARK-4498][core] Don't transition ExecutorInfo to RUNNING until Driver adds Executor
The ExecutorInfo only reaches the RUNNING state if the Driver is alive to send the ExecutorStateChanged message to master. Else, appInfo.resetRetryCount() is never called and failing Executors will eventually exceed ApplicationState.MAX_NUM_RETRY, resulting in the application being removed from the master's accounting.
JoshRosen
Author: Mark Hamstra <markhamstra@gmail.com>
Closes #3550 from markhamstra/SPARK-4498 and squashes the following commits:
8f543b1 [Mark Hamstra] Don't transition ExecutorInfo to RUNNING until Executor is added by Driver
Diffstat (limited to 'bin/spark-submit.cmd')
0 files changed, 0 insertions, 0 deletions