diff options
| author | Josh Rosen <joshrosen@databricks.com> | 2015-06-27 14:40:45 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2015-06-27 14:40:45 -0700 |
| commit | 0b5abbf5f96a5f6bfd15a65e8788cf3fa96fe54c (patch) | |
| tree | e6ec0b22ed887ec1868549f51695816eb65d765f /dev/run-tests.py | |
| parent | 4153776fd840ae075e6bb608f054091b6d3ec0c4 (diff) | |
| download | spark-0b5abbf5f96a5f6bfd15a65e8788cf3fa96fe54c.tar.gz spark-0b5abbf5f96a5f6bfd15a65e8788cf3fa96fe54c.tar.bz2 spark-0b5abbf5f96a5f6bfd15a65e8788cf3fa96fe54c.zip | |
[SPARK-8606] Prevent exceptions in RDD.getPreferredLocations() from crashing DAGScheduler
If `RDD.getPreferredLocations()` throws an exception it may crash the DAGScheduler and SparkContext. This patch addresses this by adding a try-catch block.
Author: Josh Rosen <joshrosen@databricks.com>
Closes #7023 from JoshRosen/SPARK-8606 and squashes the following commits:
770b169 [Josh Rosen] Fix getPreferredLocations() DAGScheduler crash with try block.
44a9b55 [Josh Rosen] Add test of a buggy getPartitions() method
19aa9f7 [Josh Rosen] Add (failing) regression test for getPreferredLocations() DAGScheduler crash
Diffstat (limited to 'dev/run-tests.py')
0 files changed, 0 insertions, 0 deletions