diff options
author | zsxwing <zsxwing@gmail.com> | 2014-10-07 16:00:22 -0700 |
---|---|---|
committer | Andrew Or <andrewor14@gmail.com> | 2014-10-07 16:00:31 -0700 |
commit | e8afb733ad18667d86d65a7e3fefc547b27f7998 (patch) | |
tree | 3a70b91a3b5081cb9240984ea5fe028ba1499ae4 /core/src/main | |
parent | 5531830246dd3ee9e1feed96ec565c7405ee8b95 (diff) | |
download | spark-e8afb733ad18667d86d65a7e3fefc547b27f7998.tar.gz spark-e8afb733ad18667d86d65a7e3fefc547b27f7998.tar.bz2 spark-e8afb733ad18667d86d65a7e3fefc547b27f7998.zip |
[SPARK-3777] Display "Executor ID" for Tasks in Stage page
Now the Stage page only displays "Executor"(host) for tasks. However, there may be more than one Executors running in the same host. Currently, when some task is hung, I only know the host of the faulty executor. Therefore I have to check all executors in the host.
Adding "Executor ID" in the Tasks table. would be helpful to locate the faulty executor. Here is the new page:
![add_executor_id_for_tasks](https://cloud.githubusercontent.com/assets/1000778/4505774/acb9648c-4afa-11e4-8826-8768a0a60cc9.png)
Author: zsxwing <zsxwing@gmail.com>
Closes #2642 from zsxwing/SPARK-3777 and squashes the following commits:
37945af [zsxwing] Put Executor ID and Host into one cell
4bbe2c7 [zsxwing] [SPARK-3777] Display "Executor ID" for Tasks in Stage page
(cherry picked from commit 446063eca98ae56d1ac61415f4c6e89699b8db02)
Signed-off-by: Andrew Or <andrewor14@gmail.com>
Diffstat (limited to 'core/src/main')
-rw-r--r-- | core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala b/core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala index db01be596e..2414e4c652 100644 --- a/core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala +++ b/core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala @@ -103,7 +103,7 @@ private[ui] class StagePage(parent: JobProgressTab) extends WebUIPage("stage") { val taskHeaders: Seq[String] = Seq( - "Index", "ID", "Attempt", "Status", "Locality Level", "Executor", + "Index", "ID", "Attempt", "Status", "Locality Level", "Executor ID / Host", "Launch Time", "Duration", "GC Time", "Accumulators") ++ {if (hasInput) Seq("Input") else Nil} ++ {if (hasShuffleRead) Seq("Shuffle Read") else Nil} ++ @@ -282,7 +282,7 @@ private[ui] class StagePage(parent: JobProgressTab) extends WebUIPage("stage") { }</td> <td>{info.status}</td> <td>{info.taskLocality}</td> - <td>{info.host}</td> + <td>{info.executorId} / {info.host}</td> <td>{UIUtils.formatDate(new Date(info.launchTime))}</td> <td sorttable_customkey={duration.toString}> {formatDuration} |