aboutsummaryrefslogtreecommitdiff
path: root/mllib/src
diff options
context:
space:
mode:
authorStephen Haberman <stephen@exigencecorp.com>2015-04-03 09:48:37 +0100
committerSean Owen <sowen@cloudera.com>2015-04-03 09:48:37 +0100
commitb0d884f044fea1c954da77073f3556cd9ab1e922 (patch)
tree26ffcf71a2f09d231dec33c45e780d33974b8906 /mllib/src
parent82701ee25fda64f03899713bc56f82ca6f278151 (diff)
downloadspark-b0d884f044fea1c954da77073f3556cd9ab1e922.tar.gz
spark-b0d884f044fea1c954da77073f3556cd9ab1e922.tar.bz2
spark-b0d884f044fea1c954da77073f3556cd9ab1e922.zip
[SPARK-6560][CORE] Do not suppress exceptions from writer.write.
If there is a failure in the Hadoop backend while calling writer.write, we should remember this original exception, and try to call writer.close(), but if that fails as well, still report the original exception. Note that, if writer.write fails, it is likely that writer was left in an invalid state, and so actually makes it more likely that writer.close will also fail. Which just increases the chances for writer.write's exception to be suppressed. This patch introduces an admittedly potentially too cute Utils.tryWithSafeFinally method to handle the try/finally gyrations. Author: Stephen Haberman <stephen@exigencecorp.com> Closes #5223 from stephenh/do_not_suppress_writer_exception and squashes the following commits: c7ad53f [Stephen Haberman] [SPARK-6560][CORE] Do not suppress exceptions from writer.write.
Diffstat (limited to 'mllib/src')
0 files changed, 0 insertions, 0 deletions