diff options
| author | Davies Liu <davies@databricks.com> | 2014-10-23 23:58:00 -0700 |
|---|---|---|
| committer | Xiangrui Meng <meng@databricks.com> | 2014-10-23 23:58:15 -0700 |
| commit | 926f8ca5370e506eee92cc82eb2153fe7c80a504 (patch) | |
| tree | 834166a810587bc05eea9dfbc4723cab1bc8dde5 /python | |
| parent | 5e191fac0e27f69cbf92970e9988206289564ac4 (diff) | |
| download | spark-926f8ca5370e506eee92cc82eb2153fe7c80a504.tar.gz spark-926f8ca5370e506eee92cc82eb2153fe7c80a504.tar.bz2 spark-926f8ca5370e506eee92cc82eb2153fe7c80a504.zip | |
[SPARK-2652] [PySpark] donot use KyroSerializer as default serializer
KyroSerializer can not serialize customized class without registered explicitly, use it as default serializer in PySpark will introduce some regression in MLlib.
cc mengxr
Author: Davies Liu <davies@databricks.com>
Closes #2916 from davies/revert and squashes the following commits:
43eb6d3 [Davies Liu] donot use KyroSerializer as default serializer
(cherry picked from commit 809c785bcc33e684a68ea14240a466def864199a)
Signed-off-by: Xiangrui Meng <meng@databricks.com>
Diffstat (limited to 'python')
| -rw-r--r-- | python/pyspark/context.py | 1 |
1 files changed, 0 insertions, 1 deletions
diff --git a/python/pyspark/context.py b/python/pyspark/context.py index 82f76de31a..357626edc9 100644 --- a/python/pyspark/context.py +++ b/python/pyspark/context.py @@ -40,7 +40,6 @@ from py4j.java_collections import ListConverter # These are special default configs for PySpark, they will overwrite # the default ones for Spark if they are not configured by user. DEFAULT_CONFIGS = { - "spark.serializer": "org.apache.spark.serializer.KryoSerializer", "spark.serializer.objectStreamReset": 100, "spark.rdd.compress": True, } |