diff options
author | Thomas Graves <tgraves@apache.org> | 2014-04-17 16:36:37 -0500 |
---|---|---|
committer | Thomas Graves <tgraves@apache.org> | 2014-04-17 16:36:37 -0500 |
commit | 0058b5d2c74147d24b127a5432f89ebc7050dc18 (patch) | |
tree | 5a87c957ac636689f43a76ca3b352e256e5d9763 /yarn/stable | |
parent | 69047506bf97e6e37e4079c87cb0327d3760ac41 (diff) | |
download | spark-0058b5d2c74147d24b127a5432f89ebc7050dc18.tar.gz spark-0058b5d2c74147d24b127a5432f89ebc7050dc18.tar.bz2 spark-0058b5d2c74147d24b127a5432f89ebc7050dc18.zip |
SPARK-1408 Modify Spark on Yarn to point to the history server when app ...
...finishes
Note this is dependent on https://github.com/apache/spark/pull/204 to have a working history server, but there are no code dependencies.
This also fixes SPARK-1288 yarn stable finishApplicationMaster incomplete. Since I was in there I made the diagnostic message be passed properly.
Author: Thomas Graves <tgraves@apache.org>
Closes #362 from tgravescs/SPARK-1408 and squashes the following commits:
ec89705 [Thomas Graves] Fix typo.
446122d [Thomas Graves] Make config yarn specific
f5d5373 [Thomas Graves] SPARK-1408 Modify Spark on Yarn to point to the history server when app finishes
Diffstat (limited to 'yarn/stable')
-rw-r--r-- | yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala b/yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala index 581cfe43b6..b225be6a79 100644 --- a/yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala +++ b/yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala @@ -347,8 +347,8 @@ class ApplicationMaster(args: ApplicationMasterArguments, conf: Configuration, logInfo("finishApplicationMaster with " + status) if (registered) { - // Set tracking URL to empty since we don't have a history server. - amClient.unregisterApplicationMaster(status, "" /* appMessage */ , "" /* appTrackingUrl */) + val trackingUrl = sparkConf.get("spark.yarn.historyServer.address", "") + amClient.unregisterApplicationMaster(status, diagnostics, trackingUrl) } } } |