diff options
| author | Davies Liu <davies.liu@gmail.com> | 2014-08-04 12:13:41 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@apache.org> | 2014-08-04 12:14:48 -0700 |
| commit | bfd2f39581d958d5aafaa76994f44213bcdfbb69 (patch) | |
| tree | f2f72b2b2a041624ff4462e777f19874cd477b41 /dev/github_jira_sync.py | |
| parent | 3823f6d25e2a89ca1bfa62a76f6e708c2c63f064 (diff) | |
| download | spark-bfd2f39581d958d5aafaa76994f44213bcdfbb69.tar.gz spark-bfd2f39581d958d5aafaa76994f44213bcdfbb69.tar.bz2 spark-bfd2f39581d958d5aafaa76994f44213bcdfbb69.zip | |
[SPARK-1687] [PySpark] pickable namedtuple
Add an hook to replace original namedtuple with an pickable one, then namedtuple could be used in RDDs.
PS: pyspark should be import BEFORE "from collections import namedtuple"
Author: Davies Liu <davies.liu@gmail.com>
Closes #1623 from davies/namedtuple and squashes the following commits:
045dad8 [Davies Liu] remove unrelated code changes
4132f32 [Davies Liu] address comment
55b1c1a [Davies Liu] fix tests
61f86eb [Davies Liu] replace all the reference of namedtuple to new hacked one
98df6c6 [Davies Liu] Merge branch 'master' of github.com:apache/spark into namedtuple
f7b1bde [Davies Liu] add hack for CloudPickleSerializer
0c5c849 [Davies Liu] Merge branch 'master' of github.com:apache/spark into namedtuple
21991e6 [Davies Liu] hack namedtuple in __main__ module, make it picklable.
93b03b8 [Davies Liu] pickable namedtuple
(cherry picked from commit 59f84a9531f7974a053fd4963ce9afd88273ea4c)
Signed-off-by: Josh Rosen <joshrosen@apache.org>
Diffstat (limited to 'dev/github_jira_sync.py')
0 files changed, 0 insertions, 0 deletions