diff options
| author | Bouke van der Bijl <boukevanderbijl@gmail.com> | 2014-05-05 11:19:35 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-05-05 11:20:15 -0700 |
| commit | 80f4360e770cbddabd9ca820eb254e9f8ce64ab0 (patch) | |
| tree | 2a8e7ed88af8d9a54b03721fd81a22b276d18f77 /docs/index.md | |
| parent | 5d72283ba68747b966b8d04ca985d47daa9b39e7 (diff) | |
| download | spark-80f4360e770cbddabd9ca820eb254e9f8ce64ab0.tar.gz spark-80f4360e770cbddabd9ca820eb254e9f8ce64ab0.tar.bz2 spark-80f4360e770cbddabd9ca820eb254e9f8ce64ab0.zip | |
SPARK-1721: Reset the thread classLoader in the Mesos Executor
This is because Mesos calls it with a different environment or something, the result is that the Spark jar is missing and it can't load classes.
This fixes http://apache-spark-user-list.1001560.n3.nabble.com/java-lang-ClassNotFoundException-spark-on-mesos-td3510.html
I have no idea whether this is the right fix, I can only confirm that it fixes the issue for us.
The `registered` method is called from mesos (https://github.com/apache/mesos/blob/765ff9bc2ac5a12d4362f8235b572a37d646390a/src/java/jni/org_apache_mesos_MesosExecutorDriver.cpp)
I am unsure which commit caused this regression
Author: Bouke van der Bijl <boukevanderbijl@gmail.com>
Closes #620 from bouk/mesos-classloader-fix and squashes the following commits:
c13eae0 [Bouke van der Bijl] Use getContextOrSparkClassLoader in SparkEnv and CompressionCodec
(cherry picked from commit 3292e2a71bfb5df5ba156cf7557747d164d12291)
Signed-off-by: Patrick Wendell <pwendell@gmail.com>
Diffstat (limited to 'docs/index.md')
0 files changed, 0 insertions, 0 deletions