diff options
| author | Joseph K. Bradley <joseph@databricks.com> | 2015-12-16 11:53:04 -0800 |
|---|---|---|
| committer | Joseph K. Bradley <joseph@databricks.com> | 2015-12-16 11:53:04 -0800 |
| commit | 8148cc7a5c9f52c82c2eb7652d9aeba85e72d406 (patch) | |
| tree | 55a31f4d8dbc26d6d6769c9ab0c4ed467818ab19 /docs/mllib-migration-guides.md | |
| parent | 6a880afa831348b413ba95b98ff089377b950666 (diff) | |
| download | spark-8148cc7a5c9f52c82c2eb7652d9aeba85e72d406.tar.gz spark-8148cc7a5c9f52c82c2eb7652d9aeba85e72d406.tar.bz2 spark-8148cc7a5c9f52c82c2eb7652d9aeba85e72d406.zip | |
[SPARK-11608][MLLIB][DOC] Added migration guide for MLlib 1.6
No known breaking changes, but some deprecations and changes of behavior.
CC: mengxr
Author: Joseph K. Bradley <joseph@databricks.com>
Closes #10235 from jkbradley/mllib-guide-update-1.6.
Diffstat (limited to 'docs/mllib-migration-guides.md')
| -rw-r--r-- | docs/mllib-migration-guides.md | 19 |
1 files changed, 19 insertions, 0 deletions
diff --git a/docs/mllib-migration-guides.md b/docs/mllib-migration-guides.md index 73e4fddf67..f3daef2dba 100644 --- a/docs/mllib-migration-guides.md +++ b/docs/mllib-migration-guides.md @@ -7,6 +7,25 @@ description: MLlib migration guides from before Spark SPARK_VERSION_SHORT The migration guide for the current Spark version is kept on the [MLlib Programming Guide main page](mllib-guide.html#migration-guide). +## From 1.4 to 1.5 + +In the `spark.mllib` package, there are no breaking API changes but several behavior changes: + +* [SPARK-9005](https://issues.apache.org/jira/browse/SPARK-9005): + `RegressionMetrics.explainedVariance` returns the average regression sum of squares. +* [SPARK-8600](https://issues.apache.org/jira/browse/SPARK-8600): `NaiveBayesModel.labels` become + sorted. +* [SPARK-3382](https://issues.apache.org/jira/browse/SPARK-3382): `GradientDescent` has a default + convergence tolerance `1e-3`, and hence iterations might end earlier than 1.4. + +In the `spark.ml` package, there exists one breaking API change and one behavior change: + +* [SPARK-9268](https://issues.apache.org/jira/browse/SPARK-9268): Java's varargs support is removed + from `Params.setDefault` due to a + [Scala compiler bug](https://issues.scala-lang.org/browse/SI-9013). +* [SPARK-10097](https://issues.apache.org/jira/browse/SPARK-10097): `Evaluator.isLargerBetter` is + added to indicate metric ordering. Metrics like RMSE no longer flip signs as in 1.4. + ## From 1.3 to 1.4 In the `spark.mllib` package, there were several breaking changes, but all in `DeveloperApi` or `Experimental` APIs: |