diff options
| author | Imran Rashid <irashid@cloudera.com> | 2016-06-27 16:38:03 -0500 |
|---|---|---|
| committer | Imran Rashid <irashid@cloudera.com> | 2016-06-27 16:38:03 -0500 |
| commit | c15b552dd547a129c7f0d082dab4eebbd64bee02 (patch) | |
| tree | 2ecd7a9391e0ac079302712aafb47f6bc4e88200 /R | |
| parent | 282158914d89b35a3f85388cb20bd62215f4f589 (diff) | |
| download | spark-c15b552dd547a129c7f0d082dab4eebbd64bee02.tar.gz spark-c15b552dd547a129c7f0d082dab4eebbd64bee02.tar.bz2 spark-c15b552dd547a129c7f0d082dab4eebbd64bee02.zip | |
[SPARK-16106][CORE] TaskSchedulerImpl should properly track executors added to existing hosts
## What changes were proposed in this pull request?
TaskSchedulerImpl used to only set `newExecAvailable` when a new *host* was added, not when a new executor was added to an existing host. It also didn't update some internal state tracking live executors until a task was scheduled on the executor. This patch changes it to properly update as soon as it knows about a new executor.
## How was this patch tested?
added a unit test, ran everything via jenkins.
Author: Imran Rashid <irashid@cloudera.com>
Closes #13826 from squito/SPARK-16106_executorByHosts.
Diffstat (limited to 'R')
0 files changed, 0 insertions, 0 deletions