diff options
| author | Wenchen Fan <cloud0fan@outlook.com> | 2015-03-19 15:25:32 -0400 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-03-19 15:25:32 -0400 |
| commit | 3b5aaa6a5fe0d838a8570c9d500ebca5f63764f8 (patch) | |
| tree | 5219aad7068cca7e15a15ada7629fceaa8158b53 /core | |
| parent | 8cb23a1f9a3ed08e57865bcb6cc1cc7902881073 (diff) | |
| download | spark-3b5aaa6a5fe0d838a8570c9d500ebca5f63764f8.tar.gz spark-3b5aaa6a5fe0d838a8570c9d500ebca5f63764f8.tar.bz2 spark-3b5aaa6a5fe0d838a8570c9d500ebca5f63764f8.zip | |
[Core][minor] remove unused `visitedStages` in `DAGScheduler.stageDependsOn`
We define and update `visitedStages` in `DAGScheduler.stageDependsOn`, but never read it. So we can safely remove it.
Author: Wenchen Fan <cloud0fan@outlook.com>
Closes #5086 from cloud-fan/minor and squashes the following commits:
24663ea [Wenchen Fan] remove un-used variable
Diffstat (limited to 'core')
| -rw-r--r-- | core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala | 2 |
1 files changed, 0 insertions, 2 deletions
diff --git a/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala b/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala index 1021172e6a..8feac6cb6b 100644 --- a/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala +++ b/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala @@ -1262,7 +1262,6 @@ class DAGScheduler( return true } val visitedRdds = new HashSet[RDD[_]] - val visitedStages = new HashSet[Stage] // We are manually maintaining a stack here to prevent StackOverflowError // caused by recursively visiting val waitingForVisit = new Stack[RDD[_]] @@ -1274,7 +1273,6 @@ class DAGScheduler( case shufDep: ShuffleDependency[_, _, _] => val mapStage = getShuffleMapStage(shufDep, stage.jobId) if (!mapStage.isAvailable) { - visitedStages += mapStage waitingForVisit.push(mapStage.rdd) } // Otherwise there's no need to follow the dependency back case narrowDep: NarrowDependency[_] => |