diff options
| author | Sandy Ryza <sandy@cloudera.com> | 2014-10-21 21:53:09 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-10-21 21:53:09 -0700 |
| commit | 6bb56faea8d238ea22c2de33db93b1b39f492b3a (patch) | |
| tree | 4f172ee623cd64827b6c78d8459554cd395b1660 /docs/configuration.md | |
| parent | 856b081729057f9da31a86e4bfa0dc0013492042 (diff) | |
| download | spark-6bb56faea8d238ea22c2de33db93b1b39f492b3a.tar.gz spark-6bb56faea8d238ea22c2de33db93b1b39f492b3a.tar.bz2 spark-6bb56faea8d238ea22c2de33db93b1b39f492b3a.zip | |
SPARK-1813. Add a utility to SparkConf that makes using Kryo really easy
Author: Sandy Ryza <sandy@cloudera.com>
Closes #789 from sryza/sandy-spark-1813 and squashes the following commits:
48b05e9 [Sandy Ryza] Simplify
b824932 [Sandy Ryza] Allow both spark.kryo.classesToRegister and spark.kryo.registrator at the same time
6a15bb7 [Sandy Ryza] Small fix
a2278c0 [Sandy Ryza] Respond to review comments
6ef592e [Sandy Ryza] SPARK-1813. Add a utility to SparkConf that makes using Kryo really easy
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 15 |
1 files changed, 13 insertions, 2 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 96fa1377ec..66738d3ca7 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -125,11 +125,22 @@ of the most common options to set are: </td> </tr> <tr> + <td><code>spark.kryo.classesToRegister</code></td> + <td>(none)</td> + <td> + If you use Kryo serialization, give a comma-separated list of custom class names to register + with Kryo. + See the <a href="tuning.html#data-serialization">tuning guide</a> for more details. + </td> +</tr> +<tr> <td><code>spark.kryo.registrator</code></td> <td>(none)</td> <td> - If you use Kryo serialization, set this class to register your custom classes with Kryo. - It should be set to a class that extends + If you use Kryo serialization, set this class to register your custom classes with Kryo. This + property is useful if you need to register your classes in a custom way, e.g. to specify a custom + field serializer. Otherwise <code>spark.kryo.classesToRegister</code> is simpler. It should be + set to a class that extends <a href="api/scala/index.html#org.apache.spark.serializer.KryoRegistrator"> <code>KryoRegistrator</code></a>. See the <a href="tuning.html#data-serialization">tuning guide</a> for more details. |