diff options
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 11 |
1 files changed, 10 insertions, 1 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 5c4714dc24..4bb5371cc2 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -362,7 +362,16 @@ Apart from these, the following properties are also available, and may be useful <td>spark.streaming.blockInterval</td> <td>200</td> <td> - Duration (milliseconds) of how long to batch new objects coming from network receivers. + Duration (milliseconds) of how long to batch new objects coming from network receivers used + in Spark Streaming. + </td> +</tr> +<tr> + <td>spark.streaming.unpersist</td> + <td>false</td> + <td> + Force RDDs generated and persisted by Spark Streaming to be automatically unpersisted from + Spark's memory. Setting this to true is likely to reduce Spark's RDD memory usage. </td> </tr> <tr> |