diff options
| author | Josh Rosen <joshrosen@apache.org> | 2014-08-11 19:15:01 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@apache.org> | 2014-08-11 19:15:01 -0700 |
| commit | 7712e724ad69dd0b83754e938e9799d13a4d43b9 (patch) | |
| tree | 74f2c4f7f9d31d3f2b7f641c8bb4b5667e10f3d9 /extras | |
| parent | 37338666655909502e424b4639d680271d6d4c12 (diff) | |
| download | spark-7712e724ad69dd0b83754e938e9799d13a4d43b9.tar.gz spark-7712e724ad69dd0b83754e938e9799d13a4d43b9.tar.bz2 spark-7712e724ad69dd0b83754e938e9799d13a4d43b9.zip | |
[SPARK-2931] In TaskSetManager, reset currentLocalityIndex after recomputing locality levels
This addresses SPARK-2931, a bug where getAllowedLocalityLevel() could throw ArrayIndexOutOfBoundsException. The fix here is to reset currentLocalityIndex after recomputing the locality levels.
Thanks to kayousterhout, mridulm, and lirui-intel for helping me to debug this.
Author: Josh Rosen <joshrosen@apache.org>
Closes #1896 from JoshRosen/SPARK-2931 and squashes the following commits:
48b60b5 [Josh Rosen] Move FakeRackUtil.cleanUp() info beforeEach().
6fec474 [Josh Rosen] Set currentLocalityIndex after recomputing locality levels.
9384897 [Josh Rosen] Update SPARK-2931 test to reflect changes in 63bdb1f41b4895e3a9444f7938094438a94d3007.
9ecd455 [Josh Rosen] Apply @mridulm's patch for reproducing SPARK-2931.
Diffstat (limited to 'extras')
0 files changed, 0 insertions, 0 deletions