diff options
| author | Tathagata Das <tathagata.das1565@gmail.com> | 2013-02-23 17:42:26 -0800 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2013-02-23 17:42:26 -0800 |
| commit | d853aa9658a87d644d483b1fa9d41c29e3ac0673 (patch) | |
| tree | 4a95469875543fd73e795185c335859fd442e71b /docs/configuration.md | |
| parent | 41285eaae3642b73b3ac5007a35cc4e8f1d7d084 (diff) | |
| download | spark-d853aa9658a87d644d483b1fa9d41c29e3ac0673.tar.gz spark-d853aa9658a87d644d483b1fa9d41c29e3ac0673.tar.bz2 spark-d853aa9658a87d644d483b1fa9d41c29e3ac0673.zip | |
Change spark.cleaner.delay to spark.cleaner.ttl. Updated docs.
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 6 |
1 files changed, 3 insertions, 3 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index f1ca77aa78..04eb6daaa5 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -183,7 +183,7 @@ Apart from these, the following properties are also available, and may be useful </tr> <tr> <td>spark.broadcast.factory</td> - <td>spark.broadcast. HttpBroadcastFactory</td> + <td>spark.broadcast.HttpBroadcastFactory</td> <td> Which broadcast implementation to use. </td> @@ -244,10 +244,10 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> - <td>spark.cleaner.delay</td> + <td>spark.cleaner.ttl</td> <td>(disable)</td> <td> - Duration (minutes) of how long Spark will remember any metadata (stages generated, tasks generated, etc.). + Duration (seconds) of how long Spark will remember any metadata (stages generated, tasks generated, etc.). Periodic cleanups will ensure that metadata older than this duration will be forgetten. This is useful for running Spark for many hours / days (for example, running 24/7 in case of Spark Streaming applications). Note that any RDD that persists in memory for more than this duration will be cleared as well. |