diff options
| author | Hari Shreedharan <hshreedharan@apache.org> | 2015-06-03 13:43:13 -0500 |
|---|---|---|
| committer | Imran Rashid <irashid@cloudera.com> | 2015-06-03 13:43:13 -0500 |
| commit | d2a86eb8f0fcc02304604da56c589ea58c77587a (patch) | |
| tree | 78d95e02f898f2925f0e5553bc6ba7adedfd31f0 /docs/monitoring.md | |
| parent | d053a31be93d789e3f26cf55d747ecf6ca386c29 (diff) | |
| download | spark-d2a86eb8f0fcc02304604da56c589ea58c77587a.tar.gz spark-d2a86eb8f0fcc02304604da56c589ea58c77587a.tar.bz2 spark-d2a86eb8f0fcc02304604da56c589ea58c77587a.zip | |
[SPARK-7161] [HISTORY SERVER] Provide REST api to download event logs fro...
...m History Server
This PR adds a new API that allows the user to download event logs for an application as a zip file. APIs have been added to download all logs for a given application or just for a specific attempt.
This also add an additional method to the ApplicationHistoryProvider to get the raw files, zipped.
Author: Hari Shreedharan <hshreedharan@apache.org>
Closes #5792 from harishreedharan/eventlog-download and squashes the following commits:
221cc26 [Hari Shreedharan] Update docs with new API information.
a131be6 [Hari Shreedharan] Fix style issues.
5528bd8 [Hari Shreedharan] Merge branch 'master' into eventlog-download
6e8156e [Hari Shreedharan] Simplify tests, use Guava stream copy methods.
d8ddede [Hari Shreedharan] Remove unnecessary case in EventLogDownloadResource.
ffffb53 [Hari Shreedharan] Changed interface to use zip stream. Added more tests.
1100b40 [Hari Shreedharan] Ensure that `Path` does not appear in interfaces, by rafactoring interfaces.
5a5f3e2 [Hari Shreedharan] Fix test ordering issue.
0b66948 [Hari Shreedharan] Minor formatting/import fixes.
4fc518c [Hari Shreedharan] Fix rat failures.
a48b91f [Hari Shreedharan] Refactor to make attemptId optional in the API. Also added tests.
0fc1424 [Hari Shreedharan] File download now works for individual attempts and the entire application.
350d7e8 [Hari Shreedharan] Merge remote-tracking branch 'asf/master' into eventlog-download
fd6ab00 [Hari Shreedharan] Fix style issues
32b7662 [Hari Shreedharan] Use UIRoot directly in ApiRootResource. Also, use `Response` class to set headers.
7b362b2 [Hari Shreedharan] Almost working.
3d18ebc [Hari Shreedharan] [WIP] Try getting the event log download to work.
Diffstat (limited to 'docs/monitoring.md')
| -rw-r--r-- | docs/monitoring.md | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/docs/monitoring.md b/docs/monitoring.md index e750184990..31ecddc6db 100644 --- a/docs/monitoring.md +++ b/docs/monitoring.md @@ -228,6 +228,14 @@ for a running application, at `http://localhost:4040/api/v1`. <td><code>/applications/[app-id]/storage/rdd/[rdd-id]</code></td> <td>Details for the storage status of a given RDD</td> </tr> + <tr> + <td><code>/applications/[app-id]/logs</code></td> + <td>Download the event logs for all attempts of the given application as a zip file</td> + </tr> + <tr> + <td><code>/applications/[app-id]/[attempt-id/logs</code></td> + <td>Download the event logs for the specified attempt of the given application as a zip file</td> + </tr> </table> When running on Yarn, each application has multiple attempts, so `[app-id]` is actually |