diff options
| author | Rui Li <rui.li@intel.com> | 2017-01-05 14:51:13 -0800 |
|---|---|---|
| committer | Kay Ousterhout <kayousterhout@gmail.com> | 2017-01-05 14:51:13 -0800 |
| commit | f5d18af6a8a0b9f8c2e9677f9d8ae1712eb701c6 (patch) | |
| tree | 51d688be41c3fa81e86f9b4e7a19143601497928 /sql/core | |
| parent | 30345c43b7d17bb00184b60a547225bae8ee78e7 (diff) | |
| download | spark-f5d18af6a8a0b9f8c2e9677f9d8ae1712eb701c6.tar.gz spark-f5d18af6a8a0b9f8c2e9677f9d8ae1712eb701c6.tar.bz2 spark-f5d18af6a8a0b9f8c2e9677f9d8ae1712eb701c6.zip | |
[SPARK-14958][CORE] Failed task not handled when there's error deserializing failure reason
## What changes were proposed in this pull request?
TaskResultGetter tries to deserialize the TaskEndReason before handling the failed task. If an error is thrown during deserialization, the failed task won't be handled, which leaves the job hanging.
The PR proposes to handle the failed task in a finally block.
## How was this patch tested?
In my case I hit a NoClassDefFoundError and the job hangs. Manually verified the patch can fix it.
Author: Rui Li <rui.li@intel.com>
Author: Rui Li <lirui@apache.org>
Author: Rui Li <shlr@cn.ibm.com>
Closes #12775 from lirui-intel/SPARK-14958.
Diffstat (limited to 'sql/core')
0 files changed, 0 insertions, 0 deletions