diff options
| author | Reynold Xin <rxin@apache.org> | 2014-07-15 13:13:33 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2014-07-15 13:13:33 -0700 |
| commit | e7ec815d9a2b0f89a56dc7dd3106c31a09492028 (patch) | |
| tree | 8125c193363d818258885bdf6f7a7559647c4184 /docs/configuration.md | |
| parent | 72ea56da8e383c61c6f18eeefef03b9af00f5158 (diff) | |
| download | spark-e7ec815d9a2b0f89a56dc7dd3106c31a09492028.tar.gz spark-e7ec815d9a2b0f89a56dc7dd3106c31a09492028.tar.bz2 spark-e7ec815d9a2b0f89a56dc7dd3106c31a09492028.zip | |
Added LZ4 to compression codec in configuration page.
Author: Reynold Xin <rxin@apache.org>
Closes #1417 from rxin/lz4 and squashes the following commits:
472f6a1 [Reynold Xin] Set the proper default.
9cf0b2f [Reynold Xin] Added LZ4 to compression codec in configuration page.
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 9 |
1 files changed, 4 insertions, 5 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 19fd980e60..9d3fe74414 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -336,13 +336,12 @@ Apart from these, the following properties are also available, and may be useful </tr> <tr> <td><code>spark.io.compression.codec</code></td> - <td>org.apache.spark.io.<br />LZFCompressionCodec</td> + <td>org.apache.spark.io.<br />SnappyCompressionCodec</td> <td> The codec used to compress internal data such as RDD partitions and shuffle outputs. - By default, Spark provides two codecs: <code>org.apache.spark.io.LZFCompressionCodec</code> - and <code>org.apache.spark.io.SnappyCompressionCodec</code>. Of these two choices, - Snappy offers faster compression and decompression, while LZF offers a better compression - ratio. + By default, Spark provides three codecs: <code>org.apache.spark.io.LZ4CompressionCodec</code>, + <code>org.apache.spark.io.LZFCompressionCodec</code>, + and <code>org.apache.spark.io.SnappyCompressionCodec</code>. </td> </tr> <tr> |