diff options
| author | Cheng Lian <lian@databricks.com> | 2015-05-26 00:28:47 +0800 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2015-05-26 00:28:47 +0800 |
| commit | 8af1bf10b70b9b67f18f618174e84365d69caa48 (patch) | |
| tree | a9cec94f9c6c8e9ed91d8f90fcedb5bd42b73303 /docs/programming-guide.md | |
| parent | bfeedc69a29a1dfbfc520545e3fc95389ea1b82d (diff) | |
| download | spark-8af1bf10b70b9b67f18f618174e84365d69caa48.tar.gz spark-8af1bf10b70b9b67f18f618174e84365d69caa48.tar.bz2 spark-8af1bf10b70b9b67f18f618174e84365d69caa48.zip | |
[SPARK-7842] [SQL] Makes task committing/aborting in InsertIntoHadoopFsRelation more robust
When committing/aborting a write task issued in `InsertIntoHadoopFsRelation`, if an exception is thrown from `OutputWriter.close()`, the committing/aborting process will be interrupted, and leaves messy stuff behind (e.g., the `_temporary` directory created by `FileOutputCommitter`).
This PR makes these two process more robust by catching potential exceptions and falling back to normal task committment/abort.
Author: Cheng Lian <lian@databricks.com>
Closes #6378 from liancheng/spark-7838 and squashes the following commits:
f18253a [Cheng Lian] Makes task committing/aborting in InsertIntoHadoopFsRelation more robust
Diffstat (limited to 'docs/programming-guide.md')
0 files changed, 0 insertions, 0 deletions