diff options
| author | Reynold Xin <rxin@apache.org> | 2014-08-15 17:04:15 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2014-08-15 17:04:15 -0700 |
| commit | cc3648774e9a744850107bb187f2828d447e0a48 (patch) | |
| tree | 66c0d5194762cdc156d2769e2bcd912302dac62c /dev/lint-python | |
| parent | c7032290a3f0f5545aa4f0a9a144c62571344dc8 (diff) | |
| download | spark-cc3648774e9a744850107bb187f2828d447e0a48.tar.gz spark-cc3648774e9a744850107bb187f2828d447e0a48.tar.bz2 spark-cc3648774e9a744850107bb187f2828d447e0a48.zip | |
[SPARK-3046] use executor's class loader as the default serializer classloader
The serializer is not always used in an executor thread (e.g. connection manager, broadcast), in which case the classloader might not have the user jar set, leading to corruption in deserialization.
https://issues.apache.org/jira/browse/SPARK-3046
https://issues.apache.org/jira/browse/SPARK-2878
Author: Reynold Xin <rxin@apache.org>
Closes #1972 from rxin/kryoBug and squashes the following commits:
c1c7bf0 [Reynold Xin] Made change to JavaSerializer.
7204c33 [Reynold Xin] Added imports back.
d879e67 [Reynold Xin] [SPARK-3046] use executor's class loader as the default serializer class loader.
Diffstat (limited to 'dev/lint-python')
0 files changed, 0 insertions, 0 deletions