diff options
| author | jerryshao <sshao@hortonworks.com> | 2017-01-23 13:36:41 -0800 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2017-01-23 13:36:41 -0800 |
| commit | e4974721f33e64604501f673f74052e11920d438 (patch) | |
| tree | b770a5fa5bd9b6039f499186898ef8c0f1f6edd9 /mllib | |
| parent | 5b258b8b0752d13842d40ae69107f7976678cf17 (diff) | |
| download | spark-e4974721f33e64604501f673f74052e11920d438.tar.gz spark-e4974721f33e64604501f673f74052e11920d438.tar.bz2 spark-e4974721f33e64604501f673f74052e11920d438.zip | |
[SPARK-19306][CORE] Fix inconsistent state in DiskBlockObject when expection occurred
## What changes were proposed in this pull request?
In `DiskBlockObjectWriter`, when some errors happened during writing, it will call `revertPartialWritesAndClose`, if this method again failed due to some issues like out of disk, it will throw exception without resetting the state of this writer, also skipping the revert. So here propose to fix this issue to offer user a chance to recover from such issue.
## How was this patch tested?
Existing test.
Author: jerryshao <sshao@hortonworks.com>
Closes #16657 from jerryshao/SPARK-19306.
Diffstat (limited to 'mllib')
0 files changed, 0 insertions, 0 deletions