diff options
| author | Gayathri Murali <gayathri.m.softie@gmail.com> | 2016-09-22 16:34:42 -0700 |
|---|---|---|
| committer | Joseph K. Bradley <joseph@databricks.com> | 2016-09-22 16:34:42 -0700 |
| commit | f4f6bd8c9884e3919509907307fda774f56b5ecc (patch) | |
| tree | abb388081543709adff02e6d5c3a9004d18beaf2 /project | |
| parent | 0d634875026ccf1eaf984996e9460d7673561f80 (diff) | |
| download | spark-f4f6bd8c9884e3919509907307fda774f56b5ecc.tar.gz spark-f4f6bd8c9884e3919509907307fda774f56b5ecc.tar.bz2 spark-f4f6bd8c9884e3919509907307fda774f56b5ecc.zip | |
[SPARK-16240][ML] ML persistence backward compatibility for LDA
## What changes were proposed in this pull request?
Allow Spark 2.x to load instances of LDA, LocalLDAModel, and DistributedLDAModel saved from Spark 1.6.
## How was this patch tested?
I tested this manually, saving the 3 types from 1.6 and loading them into master (2.x). In the future, we can add generic tests for testing backwards compatibility across all ML models in SPARK-15573.
Author: Joseph K. Bradley <joseph@databricks.com>
Closes #15034 from jkbradley/lda-backwards.
Diffstat (limited to 'project')
| -rw-r--r-- | project/MimaExcludes.scala | 4 |
1 files changed, 3 insertions, 1 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 0a56a6b19e..b6f64e5a70 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -44,7 +44,9 @@ object MimaExcludes { // [SPARK-16853][SQL] Fixes encoder error in DataSet typed select ProblemFilters.exclude[IncompatibleMethTypeProblem]("org.apache.spark.sql.Dataset.select"), // [SPARK-16967] Move Mesos to Module - ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.SparkMasterRegex.MESOS_REGEX") + ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.SparkMasterRegex.MESOS_REGEX"), + // [SPARK-16240] ML persistence backward compatibility for LDA + ProblemFilters.exclude[MissingTypesProblem]("org.apache.spark.ml.clustering.LDA$") ) } |