diff options
| author | Imran Rashid <irashid@cloudera.com> | 2017-02-24 13:03:37 -0800 |
|---|---|---|
| committer | Kay Ousterhout <kayousterhout@gmail.com> | 2017-02-24 13:03:37 -0800 |
| commit | 5f74148bb45912b9f867174de46e246215c93ee1 (patch) | |
| tree | 54a04ad9e57e038f4339d9e4224d9c1261c8b800 /core/src/main/scala/org | |
| parent | 5cbd3b59ba6735c59153416fa15721af6da09acf (diff) | |
| download | spark-5f74148bb45912b9f867174de46e246215c93ee1.tar.gz spark-5f74148bb45912b9f867174de46e246215c93ee1.tar.bz2 spark-5f74148bb45912b9f867174de46e246215c93ee1.zip | |
[SPARK-19597][CORE] test case for task deserialization errors
Adds a test case that ensures that Executors gracefully handle a task that fails to deserialize, by sending back a reasonable failure message. This does not change any behavior (the prior behavior was already correct), it just adds a test case to prevent regression.
Author: Imran Rashid <irashid@cloudera.com>
Closes #16930 from squito/executor_task_deserialization.
Diffstat (limited to 'core/src/main/scala/org')
| -rw-r--r-- | core/src/main/scala/org/apache/spark/executor/Executor.scala | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/core/src/main/scala/org/apache/spark/executor/Executor.scala b/core/src/main/scala/org/apache/spark/executor/Executor.scala index d762f11125..975a6e4eeb 100644 --- a/core/src/main/scala/org/apache/spark/executor/Executor.scala +++ b/core/src/main/scala/org/apache/spark/executor/Executor.scala @@ -148,6 +148,8 @@ private[spark] class Executor( startDriverHeartbeater() + private[executor] def numRunningTasks: Int = runningTasks.size() + def launchTask(context: ExecutorBackend, taskDescription: TaskDescription): Unit = { val tr = new TaskRunner(context, taskDescription) runningTasks.put(taskDescription.taskId, tr) |