index
:
spark
2.12/build
SPARK-10001-hotfix
SPARK-10001-sigint
SPARK-14511-genjavadoc
SPARK-17647
WIP-SPARK-17647
escape
genjavadoc
macros
master
packages
scala-2.12
value-classes
Mirror of Apache Spark
about
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
python
/
pyspark
/
serializers.py
Commit message (
Expand
)
Author
Age
Files
Lines
*
[SPARK-4897] [PySpark] Python 3 support
Davies Liu
2015-04-16
1
-54
/
+47
*
[SPARK-3074] [PySpark] support groupByKey() with single huge key
Davies Liu
2015-04-09
1
-1
/
+24
*
[SPARK-5154] [PySpark] [Streaming] Kafka streaming support in Python
Davies Liu
2015-02-02
1
-1
/
+8
*
[SPARK-5224] [PySpark] improve performance of parallelize list/ndarray
Davies Liu
2015-01-15
1
-0
/
+4
*
[SPARK-4841] fix zip with textFile()
Davies Liu
2014-12-15
1
-0
/
+6
*
[SPARK-4548] []SPARK-4517] improve performance of python broadcast
Davies Liu
2014-11-24
1
-171
/
+7
*
[SPARK-3721] [PySpark] broadcast objects larger than 2G
Davies Liu
2014-11-18
1
-7
/
+178
*
[SPARK-3886] [PySpark] simplify serializer, use AutoBatchedSerializer by defa...
Davies Liu
2014-11-03
1
-23
/
+13
*
[SPARK-3993] [PySpark] fix bug while reuse worker after take()
Davies Liu
2014-10-23
1
-0
/
+1
*
[SPARK-2377] Python API for Streaming
giwa
2014-10-12
1
-0
/
+3
*
[SPARK-3886] [PySpark] use AutoBatchedSerializer by default
Davies Liu
2014-10-10
1
-2
/
+2
*
[SPARK-2461] [PySpark] Add a toString method to GeneralizedLinearModel
Sandy Ryza
2014-10-06
1
-3
/
+3
*
[SPARK-3491] [MLlib] [PySpark] use pickle to serialize data in MLlib
Davies Liu
2014-09-19
1
-0
/
+36
*
[SPARK-3430] [PySpark] [Doc] generate PySpark API docs using Sphinx
Davies Liu
2014-09-16
1
-0
/
+3
*
[SPARK-3030] [PySpark] Reuse Python worker
Davies Liu
2014-09-13
1
-0
/
+4
*
[SPARK-3094] [PySpark] compatitable with PyPy
Davies Liu
2014-09-12
1
-3
/
+7
*
[SPARK-3047] [PySpark] add an option to use str in textFileRDD
Davies Liu
2014-09-11
1
-7
/
+11
*
[SPARK-3309] [PySpark] Put all public API in __all__
Davies Liu
2014-09-03
1
-1
/
+1
*
[SPARK-2790] [PySpark] fix zip with serializers which have different batch si...
Davies Liu
2014-08-19
1
-0
/
+3
*
[SPARK-1065] [PySpark] improve supporting for large broadcast
Davies Liu
2014-08-16
1
-0
/
+17
*
[PySpark] [SPARK-2954] [SPARK-2948] [SPARK-2910] [SPARK-2101] Python 2.6 Fixes
Josh Rosen
2014-08-11
1
-2
/
+2
*
[SPARK-2627] [PySpark] have the build enforce PEP 8 automatically
Nicholas Chammas
2014-08-06
1
-5
/
+16
*
[SPARK-1687] [PySpark] fix unit tests related to pickable namedtuple
Davies Liu
2014-08-04
1
-1
/
+5
*
[SPARK-1687] [PySpark] pickable namedtuple
Davies Liu
2014-08-04
1
-0
/
+60
*
[SPARK-2538] [PySpark] Hash based disk spilling aggregation
Davies Liu
2014-07-24
1
-1
/
+28
*
[SPARK-2470] PEP8 fixes to PySpark
Nicholas Chammas
2014-07-21
1
-13
/
+18
*
SPARK-1421. Make MLlib work on Python 2.6
Matei Zaharia
2014-04-05
1
-1
/
+10
*
SPARK-1414. Python API for SparkContext.wholeTextFiles
Matei Zaharia
2014-04-04
1
-1
/
+1
*
SPARK-977 Added Python RDD.zip function
Prabin Banka
2014-03-10
1
-1
/
+28
*
Switch from MUTF8 to UTF8 in PySpark serializers.
Josh Rosen
2014-01-28
1
-3
/
+3
*
The rest of the Python side of those bindings.
Tor Myklebust
2013-12-19
1
-1
/
+1
*
Removed unused basestring case from dump_stream.
Josh Rosen
2013-11-26
1
-2
/
+0
*
FramedSerializer: _dumps => dumps, _loads => loads.
Josh Rosen
2013-11-10
1
-13
/
+13
*
Send PySpark commands as bytes insetad of strings.
Josh Rosen
2013-11-10
1
-0
/
+5
*
Add custom serializer support to PySpark.
Josh Rosen
2013-11-10
1
-67
/
+243
*
Remove Pickle-wrapping of Java objects in PySpark.
Josh Rosen
2013-11-03
1
-0
/
+18
*
Replace magic lengths with constants in PySpark.
Josh Rosen
2013-11-03
1
-0
/
+6
*
Fixing SPARK-602: PythonPartitioner
Andre Schumacher
2013-10-04
1
-0
/
+4
*
Add Apache license headers and LICENSE and NOTICE files
Matei Zaharia
2013-07-16
1
-0
/
+17
*
Add Python timing instrumentation
Jey Kottalam
2013-06-21
1
-0
/
+4
*
Added accumulators to PySpark
Matei Zaharia
2013-01-20
1
-1
/
+6
*
Rename top-level 'pyspark' directory to 'python'
Josh Rosen
2013-01-01
1
-0
/
+78