diff options
| author | Matei Zaharia <matei@databricks.com> | 2014-02-24 16:58:57 -0800 |
|---|---|---|
| committer | Matei Zaharia <matei@databricks.com> | 2014-02-24 16:58:57 -0800 |
| commit | d8d190efd2d08c3894b20f6814b10f9ca2157309 (patch) | |
| tree | de0c21e8ffd3dad5567fed708d145e0f7ea9df64 /docs | |
| parent | c0ef3afa82c1eaf58ff5efec961540a74b639fd9 (diff) | |
| parent | 0187cef0f284e6cb22cb3986c327c43304daf57d (diff) | |
| download | spark-d8d190efd2d08c3894b20f6814b10f9ca2157309.tar.gz spark-d8d190efd2d08c3894b20f6814b10f9ca2157309.tar.bz2 spark-d8d190efd2d08c3894b20f6814b10f9ca2157309.zip | |
Merge pull request #641 from mateiz/spark-1124-master
SPARK-1124: Fix infinite retries of reduce stage when a map stage failed
In the previous code, if you had a failing map stage and then tried to run reduce stages on it repeatedly, the first reduce stage would fail correctly, but the later ones would mistakenly believe that all map outputs are available and start failing infinitely with fetch failures from "null". See https://spark-project.atlassian.net/browse/SPARK-1124 for an example.
This PR also cleans up code style slightly where there was a variable named "s" and some weird map manipulation.
Diffstat (limited to 'docs')
0 files changed, 0 insertions, 0 deletions