From fdd9397bbe13ff134c1a3da6cf13ed379e92ce2d Mon Sep 17 00:00:00 2001
From: Xiangrui Meng spark.ml
.
Spark ML also depends upon Spark SQL, but the relevant parts of Spark SQL do not bring additional dependencies.
-Development plan
- -If all goes well, spark.ml
will become the primary ML package at the time of the Spark 1.3 release. Initially, simple wrappers will be used to port algorithms to spark.ml
, but eventually, code will be moved to spark.ml
and spark.mllib
will be deprecated.
Advice to developers
- -During the next development cycle, new algorithms should be contributed to spark.mllib
, but we welcome patches sent to either package. If an algorithm is best expressed using the new API (e.g., feature transformers), we may ask for developers to use the new spark.ml
API.
-Wrappers for old and new algorithms can be contributed to spark.ml
.
Users will be able to use algorithms from either of the two packages. The main difficulty will be the differences in APIs between the two packages.
- - -- cgit v1.2.3