diff options
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 13 |
1 files changed, 10 insertions, 3 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index f1ca77aa78..17fdbf04d1 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -134,6 +134,13 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> + <td>spark.ui.port</td> + <td>(random)</td> + <td> + Port for your application's dashboard, which shows memory usage of each RDD. + </td> +</tr> +<tr> <td>spark.shuffle.compress</td> <td>true</td> <td> @@ -183,7 +190,7 @@ Apart from these, the following properties are also available, and may be useful </tr> <tr> <td>spark.broadcast.factory</td> - <td>spark.broadcast. HttpBroadcastFactory</td> + <td>spark.broadcast.HttpBroadcastFactory</td> <td> Which broadcast implementation to use. </td> @@ -244,10 +251,10 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> - <td>spark.cleaner.delay</td> + <td>spark.cleaner.ttl</td> <td>(disable)</td> <td> - Duration (minutes) of how long Spark will remember any metadata (stages generated, tasks generated, etc.). + Duration (seconds) of how long Spark will remember any metadata (stages generated, tasks generated, etc.). Periodic cleanups will ensure that metadata older than this duration will be forgetten. This is useful for running Spark for many hours / days (for example, running 24/7 in case of Spark Streaming applications). Note that any RDD that persists in memory for more than this duration will be cleared as well. |