diff options
| author | Guancheng (G.C.) Chen <chenguancheng@gmail.com> | 2014-08-05 11:50:08 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-08-05 11:50:08 -0700 |
| commit | ac3440f4f3c4b79070ffec7db0b08ad062b4df90 (patch) | |
| tree | 3eada4236785607385d4fb734fd5934ef21e0532 /docs/tuning.md | |
| parent | 6e821e3d1ae1ed23459bc7f1098510b968130152 (diff) | |
| download | spark-ac3440f4f3c4b79070ffec7db0b08ad062b4df90.tar.gz spark-ac3440f4f3c4b79070ffec7db0b08ad062b4df90.tar.bz2 spark-ac3440f4f3c4b79070ffec7db0b08ad062b4df90.zip | |
[SPARK-2859] Update url of Kryo project in related docs
JIRA Issue: https://issues.apache.org/jira/browse/SPARK-2859
Kryo project has been migrated from googlecode to github, hence we need to update its URL in related docs such as tuning.md.
Author: Guancheng (G.C.) Chen <chenguancheng@gmail.com>
Closes #1782 from gchen/kryo-docs and squashes the following commits:
b62543c [Guancheng (G.C.) Chen] update url of Kryo project
Diffstat (limited to 'docs/tuning.md')
| -rw-r--r-- | docs/tuning.md | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/docs/tuning.md b/docs/tuning.md index 4917c11bc1..8fb2a0433b 100644 --- a/docs/tuning.md +++ b/docs/tuning.md @@ -32,7 +32,7 @@ in your operations) and performance. It provides two serialization libraries: [`java.io.Externalizable`](http://docs.oracle.com/javase/6/docs/api/java/io/Externalizable.html). Java serialization is flexible but often quite slow, and leads to large serialized formats for many classes. -* [Kryo serialization](http://code.google.com/p/kryo/): Spark can also use +* [Kryo serialization](https://github.com/EsotericSoftware/kryo): Spark can also use the Kryo library (version 2) to serialize objects more quickly. Kryo is significantly faster and more compact than Java serialization (often as much as 10x), but does not support all `Serializable` types and requires you to *register* the classes you'll use in the program in advance @@ -68,7 +68,7 @@ conf.set("spark.kryo.registrator", "mypackage.MyRegistrator") val sc = new SparkContext(conf) {% endhighlight %} -The [Kryo documentation](http://code.google.com/p/kryo/) describes more advanced +The [Kryo documentation](https://github.com/EsotericSoftware/kryo) describes more advanced registration options, such as adding custom serialization code. If your objects are large, you may also need to increase the `spark.kryoserializer.buffer.mb` |