diff options
| author | Michael Nazario <mnazario@palantir.com> | 2015-01-28 13:55:01 -0800 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2015-01-28 13:58:46 -0800 |
| commit | e023112d332e47c6a6d1b301288d0d7d7ac66d0c (patch) | |
| tree | fbaac6c7823064460f4e926eda541465c9ccafba /mllib | |
| parent | 3bead67d5926a2a798ca0e2bc71e747380493787 (diff) | |
| download | spark-e023112d332e47c6a6d1b301288d0d7d7ac66d0c.tar.gz spark-e023112d332e47c6a6d1b301288d0d7d7ac66d0c.tar.bz2 spark-e023112d332e47c6a6d1b301288d0d7d7ac66d0c.zip | |
[SPARK-5441][pyspark] Make SerDeUtil PairRDD to Python conversions more robust
SerDeUtil.pairRDDToPython and SerDeUtil.pythonToPairRDD now both support empty RDDs by checking the result of take(1) instead of calling first which throws an exception.
Author: Michael Nazario <mnazario@palantir.com>
Closes #4236 from mnazario/feature/empty-first and squashes the following commits:
a531c0c [Michael Nazario] Added regression tests for SPARK-5441
e3b2fb6 [Michael Nazario] Added acceptance of the empty case
Diffstat (limited to 'mllib')
0 files changed, 0 insertions, 0 deletions