aboutsummaryrefslogtreecommitdiff
path: root/assembly/pom.xml
diff options
context:
space:
mode:
authorlianhuiwang <lianhuiwang09@gmail.com>2015-02-06 11:00:35 +0000
committerJosh Rosen <joshrosen@databricks.com>2015-02-06 10:50:51 -0800
commit8007a4f206ecf2c9e1823cb2bd5fff7a2dfd02ce (patch)
treee3ffe2ab4cc2b5184bf5712c306903c0672a52d8 /assembly/pom.xml
parent4ff8855e8e4c53e4979670035287c54a7fb61597 (diff)
downloadspark-8007a4f206ecf2c9e1823cb2bd5fff7a2dfd02ce.tar.gz
spark-8007a4f206ecf2c9e1823cb2bd5fff7a2dfd02ce.tar.bz2
spark-8007a4f206ecf2c9e1823cb2bd5fff7a2dfd02ce.zip
[SPARK-5470][Core]use defaultClassLoader to load classes in KryoSerializer
Now KryoSerializer load classes of classesToRegister at the time of its initialization. when we set spark.kryo.classesToRegister=class1, it will throw SparkException("Failed to load class to register with Kryo". because in KryoSerializer's initialization, classLoader cannot include class of user's jars. we need to use defaultClassLoader of Serializer in newKryo(), because executor will reset defaultClassLoader of Serializer after Serializer's initialization. thank zzcclp for reporting it to me. Author: lianhuiwang <lianhuiwang09@gmail.com> Closes #4258 from lianhuiwang/SPARK-5470 and squashes the following commits: 73b719f [lianhuiwang] do the splitting and filtering during initialization 64cf306 [lianhuiwang] use defaultClassLoader to load classes of classesToRegister in KryoSerializer
Diffstat (limited to 'assembly/pom.xml')
0 files changed, 0 insertions, 0 deletions