diff options
| author | Kan Zhang <kzhang@apache.org> | 2014-06-03 22:47:18 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2014-06-03 22:47:18 -0700 |
| commit | c402a4a685721d05932bbc578d997f330ff65a49 (patch) | |
| tree | b5a985c8b01dcf028d9ac7d7bb5e1b153d18b5ee /project | |
| parent | 4ca06256690c5e03058dd179c2fc6437a917cfee (diff) | |
| download | spark-c402a4a685721d05932bbc578d997f330ff65a49.tar.gz spark-c402a4a685721d05932bbc578d997f330ff65a49.tar.bz2 spark-c402a4a685721d05932bbc578d997f330ff65a49.zip | |
[SPARK-1817] RDD.zip() should verify partition sizes for each partition
RDD.zip() will throw an exception if it finds partition sizes are not the same.
Author: Kan Zhang <kzhang@apache.org>
Closes #944 from kanzhang/SPARK-1817 and squashes the following commits:
c073848 [Kan Zhang] [SPARK-1817] Cosmetic updates
524c670 [Kan Zhang] [SPARK-1817] RDD.zip() should verify partition sizes for each partition
Diffstat (limited to 'project')
| -rw-r--r-- | project/MimaExcludes.scala | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index fadf6a4d8b..dd7efceb23 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -54,6 +54,8 @@ object MimaExcludes { ProblemFilters.exclude[MissingMethodProblem]( "org.apache.spark.api.java.JavaDoubleRDD.countApproxDistinct$default$1") ) ++ + MimaBuild.excludeSparkClass("rdd.ZippedRDD") ++ + MimaBuild.excludeSparkClass("rdd.ZippedPartition") ++ MimaBuild.excludeSparkClass("util.SerializableHyperLogLog") case v if v.startsWith("1.0") => Seq( |