diff options
| author | Xiangrui Meng <meng@databricks.com> | 2014-11-26 08:22:50 -0800 |
|---|---|---|
| committer | Xiangrui Meng <meng@databricks.com> | 2014-11-26 08:22:50 -0800 |
| commit | 561d31d2f13cc7b1112ba9f9aa8f08bcd032aebb (patch) | |
| tree | a5085828d6b0f233d0503279b5fe06e18aec166d /project | |
| parent | 288ce583b05004a8c71dcd836fab23caff5d4ba7 (diff) | |
| download | spark-561d31d2f13cc7b1112ba9f9aa8f08bcd032aebb.tar.gz spark-561d31d2f13cc7b1112ba9f9aa8f08bcd032aebb.tar.bz2 spark-561d31d2f13cc7b1112ba9f9aa8f08bcd032aebb.zip | |
[SPARK-4614][MLLIB] Slight API changes in Matrix and Matrices
Before we have a full picture of the operators we want to add, it might be safer to hide `Matrix.transposeMultiply` in 1.2.0. Another update we want to change is `Matrix.randn` and `Matrix.rand`, both of which should take a `Random` implementation. Otherwise, it is very likely to produce inconsistent RDDs. I also added some unit tests for matrix factory methods. All APIs are new in 1.2, so there is no incompatible changes.
brkyvz
Author: Xiangrui Meng <meng@databricks.com>
Closes #3468 from mengxr/SPARK-4614 and squashes the following commits:
3b0e4e2 [Xiangrui Meng] add mima excludes
6bfd8a4 [Xiangrui Meng] hide transposeMultiply; add rng to rand and randn; add unit tests
Diffstat (limited to 'project')
| -rw-r--r-- | project/MimaExcludes.scala | 6 |
1 files changed, 6 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 94de14ddbd..230239aa40 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -47,6 +47,12 @@ object MimaExcludes { "org.apache.spark.SparkStageInfoImpl.this"), ProblemFilters.exclude[MissingMethodProblem]( "org.apache.spark.SparkStageInfo.submissionTime") + ) ++ Seq( + // SPARK-4614 + ProblemFilters.exclude[MissingMethodProblem]( + "org.apache.spark.mllib.linalg.Matrices.randn"), + ProblemFilters.exclude[MissingMethodProblem]( + "org.apache.spark.mllib.linalg.Matrices.rand") ) case v if v.startsWith("1.2") => |