aboutsummaryrefslogtreecommitdiff
path: root/python/pyspark/serializers.py
diff options
context:
space:
mode:
authorJosh Rosen <joshrosen@apache.org>2014-08-11 11:54:09 -0700
committerJosh Rosen <joshrosen@apache.org>2014-08-11 11:54:46 -0700
commit09b8a3ce0d73915d573e0ebc3e96448736b89bfa (patch)
tree044af7089b1389b2562357425f2ca4cf035c0224 /python/pyspark/serializers.py
parent3def842d941a29ca75e8e6c447952655654dc44d (diff)
downloadspark-09b8a3ce0d73915d573e0ebc3e96448736b89bfa.tar.gz
spark-09b8a3ce0d73915d573e0ebc3e96448736b89bfa.tar.bz2
spark-09b8a3ce0d73915d573e0ebc3e96448736b89bfa.zip
[PySpark] [SPARK-2954] [SPARK-2948] [SPARK-2910] [SPARK-2101] Python 2.6 Fixes
- Modify python/run-tests to test with Python 2.6 - Use unittest2 when running on Python 2.6. - Fix issue with namedtuple. - Skip TestOutputFormat.test_newhadoop on Python 2.6 until SPARK-2951 is fixed. - Fix MLlib _deserialize_double on Python 2.6. Closes #1868. Closes #1042. Author: Josh Rosen <joshrosen@apache.org> Closes #1874 from JoshRosen/python2.6 and squashes the following commits: 983d259 [Josh Rosen] [SPARK-2954] Fix MLlib _deserialize_double on Python 2.6. 5d18fd7 [Josh Rosen] [SPARK-2948] [SPARK-2910] [SPARK-2101] Python 2.6 fixes (cherry picked from commit db06a81fb7a413faa3fe0f8c35918f70454cb05d) Signed-off-by: Josh Rosen <joshrosen@apache.org>
Diffstat (limited to 'python/pyspark/serializers.py')
-rw-r--r--python/pyspark/serializers.py4
1 files changed, 2 insertions, 2 deletions
diff --git a/python/pyspark/serializers.py b/python/pyspark/serializers.py
index b35558db3e..df90cafb24 100644
--- a/python/pyspark/serializers.py
+++ b/python/pyspark/serializers.py
@@ -314,8 +314,8 @@ def _hijack_namedtuple():
_old_namedtuple = _copy_func(collections.namedtuple)
- def namedtuple(name, fields, verbose=False, rename=False):
- cls = _old_namedtuple(name, fields, verbose, rename)
+ def namedtuple(*args, **kwargs):
+ cls = _old_namedtuple(*args, **kwargs)
return _hack_namedtuple(cls)
# replace namedtuple with new one