diff options
| -rw-r--r-- | core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala | 2 | ||||
| -rw-r--r-- | docs/configuration.md | 4 |
2 files changed, 3 insertions, 3 deletions
diff --git a/core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala b/core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala index 0a7e1ec539..a7fa057ee0 100644 --- a/core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala +++ b/core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala @@ -108,7 +108,7 @@ private[spark] class JavaSerializerInstance(counterReset: Int) extends Serialize */ @DeveloperApi class JavaSerializer(conf: SparkConf) extends Serializer with Externalizable { - private var counterReset = conf.getInt("spark.serializer.objectStreamReset", 10000) + private var counterReset = conf.getInt("spark.serializer.objectStreamReset", 100) def newInstance(): SerializerInstance = new JavaSerializerInstance(counterReset) diff --git a/docs/configuration.md b/docs/configuration.md index dac8bb1d52..4e4b78153a 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -380,13 +380,13 @@ Apart from these, the following properties are also available, and may be useful </tr> <tr> <td><code>spark.serializer.objectStreamReset</code></td> - <td>10000</td> + <td>100</td> <td> When serializing using org.apache.spark.serializer.JavaSerializer, the serializer caches objects to prevent writing redundant data, however that stops garbage collection of those objects. By calling 'reset' you flush that info from the serializer, and allow old objects to be collected. To turn off this periodic reset set it to a value <= 0. - By default it will reset the serializer every 10,000 objects. + By default it will reset the serializer every 100 objects. </td> </tr> <tr> |