diff options
| author | Davies Liu <davies@databricks.com> | 2014-10-23 23:58:00 -0700 |
|---|---|---|
| committer | Xiangrui Meng <meng@databricks.com> | 2014-10-23 23:58:00 -0700 |
| commit | 809c785bcc33e684a68ea14240a466def864199a (patch) | |
| tree | c97afaf446d6a38cb79f25faa39e21ef8e62be2d /python | |
| parent | 0aea22895ce94f4f80faad5a2c41b76edac172b9 (diff) | |
| download | spark-809c785bcc33e684a68ea14240a466def864199a.tar.gz spark-809c785bcc33e684a68ea14240a466def864199a.tar.bz2 spark-809c785bcc33e684a68ea14240a466def864199a.zip | |
[SPARK-2652] [PySpark] donot use KyroSerializer as default serializer
KyroSerializer can not serialize customized class without registered explicitly, use it as default serializer in PySpark will introduce some regression in MLlib.
cc mengxr
Author: Davies Liu <davies@databricks.com>
Closes #2916 from davies/revert and squashes the following commits:
43eb6d3 [Davies Liu] donot use KyroSerializer as default serializer
Diffstat (limited to 'python')
| -rw-r--r-- | python/pyspark/context.py | 1 |
1 files changed, 0 insertions, 1 deletions
diff --git a/python/pyspark/context.py b/python/pyspark/context.py index 8d27ccb95f..5f8dcedb1e 100644 --- a/python/pyspark/context.py +++ b/python/pyspark/context.py @@ -43,7 +43,6 @@ __all__ = ['SparkContext'] # These are special default configs for PySpark, they will overwrite # the default ones for Spark if they are not configured by user. DEFAULT_CONFIGS = { - "spark.serializer": "org.apache.spark.serializer.KryoSerializer", "spark.serializer.objectStreamReset": 100, "spark.rdd.compress": True, } |