diff options
author | Alexander Ulanov <nashb@yandex.ru> | 2016-03-31 23:48:36 -0700 |
---|---|---|
committer | Xiangrui Meng <meng@databricks.com> | 2016-03-31 23:48:36 -0700 |
commit | 26867ebc67edab97376c5d8fee76df294359e461 (patch) | |
tree | 7af6e342de372beb025537f45013f5153776eeb5 /project | |
parent | 1b070637fa03ab4966f76427b15e433050eaa956 (diff) | |
download | spark-26867ebc67edab97376c5d8fee76df294359e461.tar.gz spark-26867ebc67edab97376c5d8fee76df294359e461.tar.bz2 spark-26867ebc67edab97376c5d8fee76df294359e461.zip |
[SPARK-11262][ML] Unit test for gradient, loss layers, memory management for multilayer perceptron
1.Implement LossFunction trait and implement squared error and cross entropy
loss with it
2.Implement unit test for gradient and loss
3.Implement InPlace trait and in-place layer evaluation
4.Refactor interface for ActivationFunction
5.Update of Layer and LayerModel interfaces
6.Fix random weights assignment
7.Implement memory allocation by MLP model instead of individual layers
These features decreased the memory usage and increased flexibility of
internal API.
Author: Alexander Ulanov <nashb@yandex.ru>
Author: avulanov <avulanov@gmail.com>
Closes #9229 from avulanov/mlp-refactoring.
Diffstat (limited to 'project')
-rw-r--r-- | project/MimaExcludes.scala | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 94621d7fa3..ff11775412 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -592,6 +592,11 @@ object MimaExcludes { ) ++ Seq( // [SPARK-14205][SQL] remove trait Queryable ProblemFilters.exclude[MissingTypesProblem]("org.apache.spark.sql.Dataset") + ) ++ Seq( + // [SPARK-11262][ML] Unit test for gradient, loss layers, memory management + // for multilayer perceptron. + // This class is marked as `private`. + ProblemFilters.exclude[MissingClassProblem]("org.apache.spark.ml.ann.SoftmaxFunction") ) case v if v.startsWith("1.6") => Seq( |