diff options
| author | Kay Ousterhout <kayousterhout@gmail.com> | 2014-02-05 23:38:12 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2014-02-05 23:38:12 -0800 |
| commit | 79c95527a77af32bd83a968c1a56feb22e441b7d (patch) | |
| tree | fc351522ffa2c3ea21a5fb5b4616f9fa848abe46 /core | |
| parent | 38020961d101e792393855fd00d8e42f40713754 (diff) | |
| download | spark-79c95527a77af32bd83a968c1a56feb22e441b7d.tar.gz spark-79c95527a77af32bd83a968c1a56feb22e441b7d.tar.bz2 spark-79c95527a77af32bd83a968c1a56feb22e441b7d.zip | |
Merge pull request #545 from kayousterhout/fix_progress. Closes #545.
Fix off-by-one error with task progress info log.
Author: Kay Ousterhout <kayousterhout@gmail.com>
== Merge branch commits ==
commit 29798fc685c4e7e3eb3bf91c75df7fa8ec94a235
Author: Kay Ousterhout <kayousterhout@gmail.com>
Date: Wed Feb 5 13:40:01 2014 -0800
Fix off-by-one error with task progress info log.
Diffstat (limited to 'core')
| -rw-r--r-- | core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala b/core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala index e91470800c..777f31dc5e 100644 --- a/core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala +++ b/core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala @@ -437,13 +437,13 @@ private[spark] class TaskSetManager( info.markSuccessful() removeRunningTask(tid) if (!successful(index)) { + tasksSuccessful += 1 logInfo("Finished TID %s in %d ms on %s (progress: %d/%d)".format( tid, info.duration, info.host, tasksSuccessful, numTasks)) sched.dagScheduler.taskEnded( tasks(index), Success, result.value, result.accumUpdates, info, result.metrics) // Mark successful and stop if all the tasks have succeeded. - tasksSuccessful += 1 successful(index) = true if (tasksSuccessful == numTasks) { sched.taskSetFinished(this) |