diff options
| author | Cheng Lian <lian.cs.zju@gmail.com> | 2014-04-07 22:24:12 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2014-04-07 22:24:12 -0700 |
| commit | 0d0493fcf7fc86d30b0ddd4e2c5a293c5c88eb9d (patch) | |
| tree | e16ef05587f7916f801fb8eacec698ee5837ac2a /project | |
| parent | f27e56aa612538188a8550fe72ee20b8b13304d7 (diff) | |
| download | spark-0d0493fcf7fc86d30b0ddd4e2c5a293c5c88eb9d.tar.gz spark-0d0493fcf7fc86d30b0ddd4e2c5a293c5c88eb9d.tar.bz2 spark-0d0493fcf7fc86d30b0ddd4e2c5a293c5c88eb9d.zip | |
[SPARK-1402] Added 3 more compression schemes
JIRA issue: [SPARK-1402](https://issues.apache.org/jira/browse/SPARK-1402)
This PR provides 3 more compression schemes for Spark SQL in-memory columnar storage:
* `BooleanBitSet`
* `IntDelta`
* `LongDelta`
Now there are 6 compression schemes in total, including the no-op `PassThrough` scheme.
Also fixed a bug in PR #286: not all compression schemes are added as available schemes when accessing an in-memory column, and when a column is compressed with an unrecognised scheme, `ColumnAccessor` throws exception.
Author: Cheng Lian <lian.cs.zju@gmail.com>
Closes #330 from liancheng/moreCompressionSchemes and squashes the following commits:
1d037b8 [Cheng Lian] Fixed SPARK-1436: in-memory column byte buffer must be able to be accessed multiple times
d7c0e8f [Cheng Lian] Added test suite for IntegralDelta (IntDelta & LongDelta)
3c1ad7a [Cheng Lian] Added test suite for BooleanBitSet, refactored other test suites
44fe4b2 [Cheng Lian] Refactored CompressionScheme, added 3 more compression schemes.
Diffstat (limited to 'project')
0 files changed, 0 insertions, 0 deletions