diff options
author | Andre Schumacher <schumach@icsi.berkeley.edu> | 2013-10-04 11:56:47 -0700 |
---|---|---|
committer | Andre Schumacher <schumach@icsi.berkeley.edu> | 2013-10-04 11:56:47 -0700 |
commit | c84946fe210069259f5d42ab8fd22a5ddae91d12 (patch) | |
tree | c57a9c9887f3a26334faa538b830880b8a035885 /ec2/spark_ec2.py | |
parent | 232765f7b26d933caa14e0e1bc0e4937dae90523 (diff) | |
download | spark-c84946fe210069259f5d42ab8fd22a5ddae91d12.tar.gz spark-c84946fe210069259f5d42ab8fd22a5ddae91d12.tar.bz2 spark-c84946fe210069259f5d42ab8fd22a5ddae91d12.zip |
Fixing SPARK-602: PythonPartitioner
Currently PythonPartitioner determines partition ID by hashing a
byte-array representation of PySpark's key. This PR lets
PythonPartitioner use the actual partition ID, which is required e.g.
for sorting via PySpark.
Diffstat (limited to 'ec2/spark_ec2.py')
0 files changed, 0 insertions, 0 deletions