diff options
author | Michael Gummelt <mgummelt@mesosphere.io> | 2016-08-09 10:55:33 +0100 |
---|---|---|
committer | Sean Owen <sowen@cloudera.com> | 2016-08-09 10:55:33 +0100 |
commit | 62e62124419f3fa07b324f5e42feb2c5b4fde715 (patch) | |
tree | a9ad17839a122ab0228c557d432d3ec8b073db89 /docs/running-on-mesos.md | |
parent | 2154345b6a1cb193b1380ab386912e478928c6b2 (diff) | |
download | spark-62e62124419f3fa07b324f5e42feb2c5b4fde715.tar.gz spark-62e62124419f3fa07b324f5e42feb2c5b4fde715.tar.bz2 spark-62e62124419f3fa07b324f5e42feb2c5b4fde715.zip |
[SPARK-16809] enable history server links in dispatcher UI
## What changes were proposed in this pull request?
Links the Spark Mesos Dispatcher UI to the history server UI
- adds spark.mesos.dispatcher.historyServer.url
- explicitly generates frameworkIDs for the launched drivers, so the dispatcher knows how to correlate drivers and frameworkIDs
## How was this patch tested?
manual testing
Author: Michael Gummelt <mgummelt@mesosphere.io>
Author: Sergiusz Urbaniak <sur@mesosphere.io>
Closes #14414 from mgummelt/history-server.
Diffstat (limited to 'docs/running-on-mesos.md')
-rw-r--r-- | docs/running-on-mesos.md | 10 |
1 files changed, 10 insertions, 0 deletions
diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md index d037e7be0a..613da68531 100644 --- a/docs/running-on-mesos.md +++ b/docs/running-on-mesos.md @@ -468,6 +468,16 @@ See the [configuration page](configuration.html) for information on Spark config If unset it will point to Spark's internal web UI. </td> </tr> +<tr> + <td><code>spark.mesos.dispatcher.historyServer.url</code></td> + <td><code>(none)</code></td> + <td> + Set the URL of the <a href="http://spark.apache.org/docs/latest/monitoring.html#viewing-after-the-fact">history + server</a>. The dispatcher will then link each driver to its entry + in the history server. + </td> +</tr> + </table> # Troubleshooting and Debugging |