diff options
| author | Jeroen Schot <jeroen.schot@surfsara.nl> | 2015-12-02 09:40:07 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-12-02 09:40:07 +0000 |
| commit | 128c29035b4e7383cc3a9a6c7a9ab6136205ac6c (patch) | |
| tree | 8f3233cd941b1f67f5a06cee2cd056fee7d86df9 /project | |
| parent | 4375eb3f48fc7ae90caf6c21a0d3ab0b66bf4efa (diff) | |
| download | spark-128c29035b4e7383cc3a9a6c7a9ab6136205ac6c.tar.gz spark-128c29035b4e7383cc3a9a6c7a9ab6136205ac6c.tar.bz2 spark-128c29035b4e7383cc3a9a6c7a9ab6136205ac6c.zip | |
[SPARK-3580][CORE] Add Consistent Method To Get Number of RDD Partitions Across Different Languages
I have tried to address all the comments in pull request https://github.com/apache/spark/pull/2447.
Note that the second commit (using the new method in all internal code of all components) is quite intrusive and could be omitted.
Author: Jeroen Schot <jeroen.schot@surfsara.nl>
Closes #9767 from schot/master.
Diffstat (limited to 'project')
| -rw-r--r-- | project/MimaExcludes.scala | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 566bfe8efb..d3a3c0ceb6 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -155,6 +155,10 @@ object MimaExcludes { "org.apache.spark.storage.BlockManagerMessages$GetRpcHostPortForExecutor"), ProblemFilters.exclude[MissingClassProblem]( "org.apache.spark.storage.BlockManagerMessages$GetRpcHostPortForExecutor$") + ) ++ Seq( + // SPARK-3580 Add getNumPartitions method to JavaRDD + ProblemFilters.exclude[MissingMethodProblem]( + "org.apache.spark.api.java.JavaRDDLike.getNumPartitions") ) case v if v.startsWith("1.5") => Seq( |