diff options
| author | Ryan Williams <ryan.blake.williams@gmail.com> | 2015-07-27 12:54:08 -0500 |
|---|---|---|
| committer | Imran Rashid <irashid@cloudera.com> | 2015-07-27 12:54:08 -0500 |
| commit | c0b7df68f81c2a2a9c1065009fe75c278fa30499 (patch) | |
| tree | 562d763ea477992ff175b8ea2cb24d238783f1c2 /core | |
| parent | ecad9d4346ec158746e61aebdf1590215a77f369 (diff) | |
| download | spark-c0b7df68f81c2a2a9c1065009fe75c278fa30499.tar.gz spark-c0b7df68f81c2a2a9c1065009fe75c278fa30499.tar.bz2 spark-c0b7df68f81c2a2a9c1065009fe75c278fa30499.zip | |
[SPARK-9366] use task's stageAttemptId in TaskEnd event
Author: Ryan Williams <ryan.blake.williams@gmail.com>
Closes #7681 from ryan-williams/task-stage-attempt and squashes the following commits:
d6d5f0f [Ryan Williams] use task's stageAttemptId in TaskEnd event
Diffstat (limited to 'core')
| -rw-r--r-- | core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala b/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala index 552dabcfa5..b6a833bbb0 100644 --- a/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala +++ b/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala @@ -927,7 +927,7 @@ class DAGScheduler( // The success case is dealt with separately below, since we need to compute accumulator // updates before posting. if (event.reason != Success) { - val attemptId = stageIdToStage.get(task.stageId).map(_.latestInfo.attemptId).getOrElse(-1) + val attemptId = task.stageAttemptId listenerBus.post(SparkListenerTaskEnd(stageId, attemptId, taskType, event.reason, event.taskInfo, event.taskMetrics)) } |