diff options
| author | Andrew Or <andrew@databricks.com> | 2015-11-12 15:47:29 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-11-12 15:47:29 -0800 |
| commit | cf38fc7551f4743958c2fdc7931affd672755e68 (patch) | |
| tree | 360abd0dbd5d95610c932565d33e930d2dfdf704 /docs/tuning.md | |
| parent | 74c30049a8bf9841eeca48f827572c2044912e21 (diff) | |
| download | spark-cf38fc7551f4743958c2fdc7931affd672755e68.tar.gz spark-cf38fc7551f4743958c2fdc7931affd672755e68.tar.bz2 spark-cf38fc7551f4743958c2fdc7931affd672755e68.zip | |
[SPARK-11670] Fix incorrect kryo buffer default value in docs
<img width="931" alt="screen shot 2015-11-11 at 1 53 21 pm" src="https://cloud.githubusercontent.com/assets/2133137/11108261/35d183d4-889a-11e5-9572-85e9d6cebd26.png">
Author: Andrew Or <andrew@databricks.com>
Closes #9638 from andrewor14/fix-kryo-docs.
Diffstat (limited to 'docs/tuning.md')
| -rw-r--r-- | docs/tuning.md | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/docs/tuning.md b/docs/tuning.md index 6936912a6b..879340a015 100644 --- a/docs/tuning.md +++ b/docs/tuning.md @@ -61,8 +61,8 @@ The [Kryo documentation](https://github.com/EsotericSoftware/kryo) describes mor registration options, such as adding custom serialization code. If your objects are large, you may also need to increase the `spark.kryoserializer.buffer` -config property. The default is 2, but this value needs to be large enough to hold the *largest* -object you will serialize. +[config](configuration.html#compression-and-serialization). This value needs to be large enough +to hold the *largest* object you will serialize. Finally, if you don't register your custom classes, Kryo will still work, but it will have to store the full class name with each object, which is wasteful. |