diff options
| author | Patrick Wendell <pwendell@gmail.com> | 2013-10-18 23:08:44 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2013-10-18 23:08:44 -0700 |
| commit | 6b6283628553616efb414c15f6e3791815c12016 (patch) | |
| tree | 6159ccc0d1d09a7fa1a091f73ce203781e2087ea /docs | |
| parent | 35befe07bb79411f453cf05d482ff051fa827b47 (diff) | |
| download | spark-6b6283628553616efb414c15f6e3791815c12016.tar.gz spark-6b6283628553616efb414c15f6e3791815c12016.tar.bz2 spark-6b6283628553616efb414c15f6e3791815c12016.zip | |
Clarify compression property.
Clarifies that this governs compression of internal data, not input
data or output data.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/configuration.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 7940d41a27..3cf43ab305 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -149,7 +149,7 @@ Apart from these, the following properties are also available, and may be useful <td>spark.io.compression.codec</td> <td>org.apache.spark.io.<br />LZFCompressionCodec</td> <td> - The compression codec class to use for various compressions. By default, Spark provides two + The codec used to compress internal data such as RDD partitions and shuffle outputs. By default, Spark provides two codecs: <code>org.apache.spark.io.LZFCompressionCodec</code> and <code>org.apache.spark.io.SnappyCompressionCodec</code>. </td> </tr> |