diff options
| author | scwf <wangfei1@huawei.com> | 2014-10-02 13:47:30 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2014-10-02 13:47:30 -0700 |
| commit | c6469a02f14e8c23e9b4e1336768f8bbfc15f5d8 (patch) | |
| tree | 2dca01b186e4fbe2557437ff3f88e16111d69716 /docs/configuration.md | |
| parent | b4fb7b80a0d863500943d788ad3e34d502a6dafa (diff) | |
| download | spark-c6469a02f14e8c23e9b4e1336768f8bbfc15f5d8.tar.gz spark-c6469a02f14e8c23e9b4e1336768f8bbfc15f5d8.tar.bz2 spark-c6469a02f14e8c23e9b4e1336768f8bbfc15f5d8.zip | |
[SPARK-3766][Doc]Snappy is also the default compress codec for broadcast variables
Author: scwf <wangfei1@huawei.com>
Closes #2632 from scwf/compress-doc and squashes the following commits:
7983a1a [scwf] snappy is the default compression codec for broadcast
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 9 |
1 files changed, 5 insertions, 4 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 791b6f2aa3..316490f0f4 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -413,10 +413,11 @@ Apart from these, the following properties are also available, and may be useful <td><code>spark.io.compression.codec</code></td> <td>snappy</td> <td> - The codec used to compress internal data such as RDD partitions and shuffle outputs. By default, - Spark provides three codecs: <code>lz4</code>, <code>lzf</code>, and <code>snappy</code>. You - can also use fully qualified class names to specify the codec, e.g. - <code>org.apache.spark.io.LZ4CompressionCodec</code>, + The codec used to compress internal data such as RDD partitions, broadcast variables and + shuffle outputs. By default, Spark provides three codecs: <code>lz4</code>, <code>lzf</code>, + and <code>snappy</code>. You can also use fully qualified class names to specify the codec, + e.g. + <code>org.apache.spark.io.LZ4CompressionCodec</code>, <code>org.apache.spark.io.LZFCompressionCodec</code>, and <code>org.apache.spark.io.SnappyCompressionCodec</code>. </td> |