diff options
author | Matei Zaharia <matei.zaharia@gmail.com> | 2013-07-15 01:55:54 +0000 |
---|---|---|
committer | Matei Zaharia <matei.zaharia@gmail.com> | 2013-07-15 01:55:54 +0000 |
commit | d47c16f78d5cb935bd4022c9bed8376691371682 (patch) | |
tree | 6bfc4c3c47b8c39bc4fe99a69f355e45091d745b /docs | |
parent | 238d0e6893b758a541aa782c559215b836ec2db6 (diff) | |
download | spark-d47c16f78d5cb935bd4022c9bed8376691371682.tar.gz spark-d47c16f78d5cb935bd4022c9bed8376691371682.tar.bz2 spark-d47c16f78d5cb935bd4022c9bed8376691371682.zip |
Add an option to disable reference tracking in Kryo
Diffstat (limited to 'docs')
-rw-r--r-- | docs/configuration.md | 12 |
1 files changed, 11 insertions, 1 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 5a80510959..5c06897cae 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -198,8 +198,18 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> + <td>spark.kryo.referenceTracking</td> + <td>true</td> + <td> + Whether to track references to the same object when serializing data with Kryo, which is + necessary if your object graphs have loops and useful for efficiency if they contain multiple + copies of the same object. Can be disabled to improve performance if you know this is not the + case. + </td> +</tr> +<tr> <td>spark.kryoserializer.buffer.mb</td> - <td>32</td> + <td>2</td> <td> Maximum object size to allow within Kryo (the library needs to create a buffer at least as large as the largest single object you'll serialize). Increase this if you get a "buffer limit |