diff options
| author | petermaxlee <petermaxlee@gmail.com> | 2016-07-06 10:46:22 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-07-06 10:46:22 -0700 |
| commit | 480357cc6d71c682fe703611c71c1e6a36e6ce9a (patch) | |
| tree | 76e8159ba07e929d2373dfefdd8c398e19854f43 /core/src/main/scala/org/apache/spark | |
| parent | 4e14199ff740ea186eb2cec2e5cf901b58c5f90e (diff) | |
| download | spark-480357cc6d71c682fe703611c71c1e6a36e6ce9a.tar.gz spark-480357cc6d71c682fe703611c71c1e6a36e6ce9a.tar.bz2 spark-480357cc6d71c682fe703611c71c1e6a36e6ce9a.zip | |
[SPARK-16304] LinkageError should not crash Spark executor
## What changes were proposed in this pull request?
This patch updates the failure handling logic so Spark executor does not crash when seeing LinkageError.
## How was this patch tested?
Added an end-to-end test in FailureSuite.
Author: petermaxlee <petermaxlee@gmail.com>
Closes #13982 from petermaxlee/SPARK-16304.
Diffstat (limited to 'core/src/main/scala/org/apache/spark')
| -rw-r--r-- | core/src/main/scala/org/apache/spark/util/Utils.scala | 6 |
1 files changed, 5 insertions, 1 deletions
diff --git a/core/src/main/scala/org/apache/spark/util/Utils.scala b/core/src/main/scala/org/apache/spark/util/Utils.scala index 156cf1748b..298e6243aa 100644 --- a/core/src/main/scala/org/apache/spark/util/Utils.scala +++ b/core/src/main/scala/org/apache/spark/util/Utils.scala @@ -1881,7 +1881,11 @@ private[spark] object Utils extends Logging { /** Returns true if the given exception was fatal. See docs for scala.util.control.NonFatal. */ def isFatalError(e: Throwable): Boolean = { e match { - case NonFatal(_) | _: InterruptedException | _: NotImplementedError | _: ControlThrowable => + case NonFatal(_) | + _: InterruptedException | + _: NotImplementedError | + _: ControlThrowable | + _: LinkageError => false case _ => true |