aboutsummaryrefslogtreecommitdiff
path: root/conf
diff options
context:
space:
mode:
authorKay Ousterhout <kayousterhout@gmail.com>2015-10-22 11:39:06 -0700
committerKay Ousterhout <kayousterhout@gmail.com>2015-10-22 11:39:06 -0700
commit3535b91ddc9fd05b613a121e09263b0f378bd5fa (patch)
treef6c0247ce50670a513c47d91884172ff32a2222b /conf
parent7bb6d31cff279776f90744407291682774cfe1c2 (diff)
downloadspark-3535b91ddc9fd05b613a121e09263b0f378bd5fa.tar.gz
spark-3535b91ddc9fd05b613a121e09263b0f378bd5fa.tar.bz2
spark-3535b91ddc9fd05b613a121e09263b0f378bd5fa.zip
[SPARK-11163] Remove unnecessary addPendingTask calls.
This commit removes unnecessary calls to addPendingTask in TaskSetManager.executorLost. These calls are unnecessary: for tasks that are still pending and haven't been launched, they're still in all of the correct pending lists, so calling addPendingTask has no effect. For tasks that are currently running (which may still be in the pending lists, depending on how they were scheduled), we call addPendingTask in handleFailedTask, so the calls at the beginning of executorLost are redundant. I think these calls are left over from when we re-computed the locality levels in addPendingTask; now that we call recomputeLocality separately, I don't think these are necessary. Now that those calls are removed, the readding parameter in addPendingTask is no longer necessary, so this commit also removes that parameter. markhamstra can you take a look at this? cc vanzin Author: Kay Ousterhout <kayousterhout@gmail.com> Closes #9154 from kayousterhout/SPARK-11163.
Diffstat (limited to 'conf')
0 files changed, 0 insertions, 0 deletions