aboutsummaryrefslogtreecommitdiff
path: root/python/pyspark/serializers.py
diff options
context:
space:
mode:
authorJosh Rosen <joshrosen@apache.org>2014-08-11 11:54:09 -0700
committerJosh Rosen <joshrosen@apache.org>2014-08-11 11:54:09 -0700
commitdb06a81fb7a413faa3fe0f8c35918f70454cb05d (patch)
tree7d6b7e1766aadf0a875d5577ee349b73c817ceef /python/pyspark/serializers.py
parentba28a8fcbc3ba432e7ea4d6f0b535450a6ec96c6 (diff)
downloadspark-db06a81fb7a413faa3fe0f8c35918f70454cb05d.tar.gz
spark-db06a81fb7a413faa3fe0f8c35918f70454cb05d.tar.bz2
spark-db06a81fb7a413faa3fe0f8c35918f70454cb05d.zip
[PySpark] [SPARK-2954] [SPARK-2948] [SPARK-2910] [SPARK-2101] Python 2.6 Fixes
- Modify python/run-tests to test with Python 2.6 - Use unittest2 when running on Python 2.6. - Fix issue with namedtuple. - Skip TestOutputFormat.test_newhadoop on Python 2.6 until SPARK-2951 is fixed. - Fix MLlib _deserialize_double on Python 2.6. Closes #1868. Closes #1042. Author: Josh Rosen <joshrosen@apache.org> Closes #1874 from JoshRosen/python2.6 and squashes the following commits: 983d259 [Josh Rosen] [SPARK-2954] Fix MLlib _deserialize_double on Python 2.6. 5d18fd7 [Josh Rosen] [SPARK-2948] [SPARK-2910] [SPARK-2101] Python 2.6 fixes
Diffstat (limited to 'python/pyspark/serializers.py')
-rw-r--r--python/pyspark/serializers.py4
1 files changed, 2 insertions, 2 deletions
diff --git a/python/pyspark/serializers.py b/python/pyspark/serializers.py
index b35558db3e..df90cafb24 100644
--- a/python/pyspark/serializers.py
+++ b/python/pyspark/serializers.py
@@ -314,8 +314,8 @@ def _hijack_namedtuple():
_old_namedtuple = _copy_func(collections.namedtuple)
- def namedtuple(name, fields, verbose=False, rename=False):
- cls = _old_namedtuple(name, fields, verbose, rename)
+ def namedtuple(*args, **kwargs):
+ cls = _old_namedtuple(*args, **kwargs)
return _hack_namedtuple(cls)
# replace namedtuple with new one