diff options
| author | Shixiong Zhu <shixiong@databricks.com> | 2015-11-26 18:56:22 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-11-26 18:56:22 -0800 |
| commit | 0c1e72e7f79231e537299b57a1ab7cd843171923 (patch) | |
| tree | 8a8dbbb13dadb1a5459a6d6c6b6af24e43543772 /project | |
| parent | 4376b5bea8171e4e73b3dbabbfdf84fa1afd140b (diff) | |
| download | spark-0c1e72e7f79231e537299b57a1ab7cd843171923.tar.gz spark-0c1e72e7f79231e537299b57a1ab7cd843171923.tar.bz2 spark-0c1e72e7f79231e537299b57a1ab7cd843171923.zip | |
[SPARK-11996][CORE] Make the executor thread dump work again
In the previous implementation, the driver needs to know the executor listening address to send the thread dump request. However, in Netty RPC, the executor doesn't listen to any port, so the executor thread dump feature is broken.
This patch makes the driver use the endpointRef stored in BlockManagerMasterEndpoint to send the thread dump request to fix it.
Author: Shixiong Zhu <shixiong@databricks.com>
Closes #9976 from zsxwing/executor-thread-dump.
Diffstat (limited to 'project')
| -rw-r--r-- | project/MimaExcludes.scala | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 54a9ad956d..566bfe8efb 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -147,6 +147,14 @@ object MimaExcludes { // SPARK-4557 Changed foreachRDD to use VoidFunction ProblemFilters.exclude[MissingMethodProblem]( "org.apache.spark.streaming.api.java.JavaDStreamLike.foreachRDD") + ) ++ Seq( + // SPARK-11996 Make the executor thread dump work again + ProblemFilters.exclude[MissingClassProblem]("org.apache.spark.executor.ExecutorEndpoint"), + ProblemFilters.exclude[MissingClassProblem]("org.apache.spark.executor.ExecutorEndpoint$"), + ProblemFilters.exclude[MissingClassProblem]( + "org.apache.spark.storage.BlockManagerMessages$GetRpcHostPortForExecutor"), + ProblemFilters.exclude[MissingClassProblem]( + "org.apache.spark.storage.BlockManagerMessages$GetRpcHostPortForExecutor$") ) case v if v.startsWith("1.5") => Seq( |