diff options
| author | zsxwing <zsxwing@gmail.com> | 2015-01-04 21:18:33 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-01-04 21:18:33 -0800 |
| commit | 5c506cecb933b156b2f06a688ee08c4347bf0d47 (patch) | |
| tree | f0f090f11a3fd83696056bd3eed9087b4cb59edd | |
| parent | 27e7f5a7237d9d64a3b2c8a030ba3e3a9a96b26c (diff) | |
| download | spark-5c506cecb933b156b2f06a688ee08c4347bf0d47.tar.gz spark-5c506cecb933b156b2f06a688ee08c4347bf0d47.tar.bz2 spark-5c506cecb933b156b2f06a688ee08c4347bf0d47.zip | |
[SPARK-5074][Core] Fix a non-deterministic test failure
Add `assert(sc.listenerBus.waitUntilEmpty(WAIT_TIMEOUT_MILLIS))` to make sure `sparkListener` receive the message.
Author: zsxwing <zsxwing@gmail.com>
Closes #3889 from zsxwing/SPARK-5074 and squashes the following commits:
e61c198 [zsxwing] Fix a non-deterministic test failure
| -rw-r--r-- | core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala b/core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala index d6ec9e129c..d30eb10bbe 100644 --- a/core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala +++ b/core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala @@ -247,6 +247,7 @@ class DAGSchedulerSuite extends TestKit(ActorSystem("DAGSchedulerSuite")) with F test("[SPARK-3353] parent stage should have lower stage id") { sparkListener.stageByOrderOfExecution.clear() sc.parallelize(1 to 10).map(x => (x, x)).reduceByKey(_ + _, 4).count() + assert(sc.listenerBus.waitUntilEmpty(WAIT_TIMEOUT_MILLIS)) assert(sparkListener.stageByOrderOfExecution.length === 2) assert(sparkListener.stageByOrderOfExecution(0) < sparkListener.stageByOrderOfExecution(1)) } |