diff options
Diffstat (limited to 'docs/monitoring.md')
| -rw-r--r-- | docs/monitoring.md | 25 |
1 files changed, 24 insertions, 1 deletions
diff --git a/docs/monitoring.md b/docs/monitoring.md index 009a344dff..37ede476c1 100644 --- a/docs/monitoring.md +++ b/docs/monitoring.md @@ -86,7 +86,7 @@ follows: </td> </tr> <tr> - <td>spark.history.fs.updateInterval</td> + <td>spark.history.fs.update.interval.seconds</td> <td>10</td> <td> The period, in seconds, at which information displayed by this history server is updated. @@ -145,6 +145,29 @@ follows: If disabled, no access control checks are made. </td> </tr> + <tr> + <td>spark.history.fs.cleaner.enabled</td> + <td>false</td> + <td> + Specifies whether the History Server should periodically clean up event logs from storage. + </td> + </tr> + <tr> + <td>spark.history.fs.cleaner.interval.seconds</td> + <td>86400</td> + <td> + How often the job history cleaner checks for files to delete, in seconds. Defaults to 86400 (one day). + Files are only deleted if they are older than spark.history.fs.cleaner.maxAge.seconds. + </td> + </tr> + <tr> + <td>spark.history.fs.cleaner.maxAge.seconds</td> + <td>3600 * 24 * 7</td> + <td> + Job history files older than this many seconds will be deleted when the history cleaner runs. + Defaults to 3600 * 24 * 7 (1 week). + </td> + </tr> </table> Note that in all of these UIs, the tables are sortable by clicking their headers, |