diff options
| author | Imran Rashid <irashid@cloudera.com> | 2016-12-14 12:26:49 -0600 |
|---|---|---|
| committer | Imran Rashid <irashid@cloudera.com> | 2016-12-14 12:27:01 -0600 |
| commit | ac013ea58933a2057475f7accd197b9ed01b495e (patch) | |
| tree | 3b03ea6731e439485127178035e0358c940312da /launcher | |
| parent | cccd64393ea633e29d4a505fb0a7c01b51a79af8 (diff) | |
| download | spark-ac013ea58933a2057475f7accd197b9ed01b495e.tar.gz spark-ac013ea58933a2057475f7accd197b9ed01b495e.tar.bz2 spark-ac013ea58933a2057475f7accd197b9ed01b495e.zip | |
[SPARK-18846][SCHEDULER] Fix flakiness in SchedulerIntegrationSuite
There is a small race in SchedulerIntegrationSuite.
The test assumes that the taskscheduler thread
processing that last task will finish before the DAGScheduler processes
the task event and notifies the job waiter, but that is not 100%
guaranteed.
ran the test locally a bunch of times, never failed, though admittedly
it never failed locally for me before either. However I am nearly 100%
certain this is what caused the failure of one jenkins build
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68694/consoleFull
(which is long gone now, sorry -- I fixed it as part of
https://github.com/apache/spark/pull/14079 initially)
Author: Imran Rashid <irashid@cloudera.com>
Closes #16270 from squito/sched_integ_flakiness.
Diffstat (limited to 'launcher')
0 files changed, 0 insertions, 0 deletions