diff options
| author | luluorta <luluorta@gmail.com> | 2014-09-02 19:25:52 -0700 |
|---|---|---|
| committer | Ankur Dave <ankurdave@gmail.com> | 2014-09-02 19:26:27 -0700 |
| commit | 9b225ac3072de522b40b46aba6df1f1c231f13ef (patch) | |
| tree | c43b1a6a9176d93410079fd77d833c40c4cd9116 /sql/catalyst/src/main/scala/org/apache | |
| parent | e9bb12bea9fbef94332fbec88e3cd9197a27b7ad (diff) | |
| download | spark-9b225ac3072de522b40b46aba6df1f1c231f13ef.tar.gz spark-9b225ac3072de522b40b46aba6df1f1c231f13ef.tar.bz2 spark-9b225ac3072de522b40b46aba6df1f1c231f13ef.zip | |
[SPARK-2823][GraphX]fix GraphX EdgeRDD zipPartitions
If the users set “spark.default.parallelism” and the value is different with the EdgeRDD partition number, GraphX jobs will throw:
java.lang.IllegalArgumentException: Can't zip RDDs with unequal numbers of partitions
Author: luluorta <luluorta@gmail.com>
Closes #1763 from luluorta/fix-graph-zip and squashes the following commits:
8338961 [luluorta] fix GraphX EdgeRDD zipPartitions
Diffstat (limited to 'sql/catalyst/src/main/scala/org/apache')
0 files changed, 0 insertions, 0 deletions