diff options
| author | Josh Rosen <joshrosen@databricks.com> | 2015-05-17 09:30:49 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2015-05-17 09:30:49 -0700 |
| commit | f2cc6b5bccc3a70fd7d69183b1a068800831fe19 (patch) | |
| tree | 20a9b38f0a75bdbd383db83077eb216a3d3f1c98 /sql | |
| parent | 50217667cc1239ed3b15f4d10907b727ed85d7fa (diff) | |
| download | spark-f2cc6b5bccc3a70fd7d69183b1a068800831fe19.tar.gz spark-f2cc6b5bccc3a70fd7d69183b1a068800831fe19.tar.bz2 spark-f2cc6b5bccc3a70fd7d69183b1a068800831fe19.zip | |
[SPARK-7660] Wrap SnappyOutputStream to work around snappy-java bug
This patch wraps `SnappyOutputStream` to ensure that `close()` is idempotent and to guard against write-after-`close()` bugs. This is a workaround for https://github.com/xerial/snappy-java/issues/107, a bug where a non-idempotent `close()` method can lead to stream corruption. We can remove this workaround if we upgrade to a snappy-java version that contains my fix for this bug, but in the meantime this patch offers a backportable Spark fix.
Author: Josh Rosen <joshrosen@databricks.com>
Closes #6176 from JoshRosen/SPARK-7660-wrap-snappy and squashes the following commits:
8b77aae [Josh Rosen] Wrap SnappyOutputStream to fix SPARK-7660
Diffstat (limited to 'sql')
0 files changed, 0 insertions, 0 deletions