aboutsummaryrefslogtreecommitdiff
path: root/project
diff options
context:
space:
mode:
authorAlexander Ulanov <nashb@yandex.ru>2016-03-31 23:48:36 -0700
committerXiangrui Meng <meng@databricks.com>2016-03-31 23:48:36 -0700
commit26867ebc67edab97376c5d8fee76df294359e461 (patch)
tree7af6e342de372beb025537f45013f5153776eeb5 /project
parent1b070637fa03ab4966f76427b15e433050eaa956 (diff)
downloadspark-26867ebc67edab97376c5d8fee76df294359e461.tar.gz
spark-26867ebc67edab97376c5d8fee76df294359e461.tar.bz2
spark-26867ebc67edab97376c5d8fee76df294359e461.zip
[SPARK-11262][ML] Unit test for gradient, loss layers, memory management for multilayer perceptron
1.Implement LossFunction trait and implement squared error and cross entropy loss with it 2.Implement unit test for gradient and loss 3.Implement InPlace trait and in-place layer evaluation 4.Refactor interface for ActivationFunction 5.Update of Layer and LayerModel interfaces 6.Fix random weights assignment 7.Implement memory allocation by MLP model instead of individual layers These features decreased the memory usage and increased flexibility of internal API. Author: Alexander Ulanov <nashb@yandex.ru> Author: avulanov <avulanov@gmail.com> Closes #9229 from avulanov/mlp-refactoring.
Diffstat (limited to 'project')
-rw-r--r--project/MimaExcludes.scala5
1 files changed, 5 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala
index 94621d7fa3..ff11775412 100644
--- a/project/MimaExcludes.scala
+++ b/project/MimaExcludes.scala
@@ -592,6 +592,11 @@ object MimaExcludes {
) ++ Seq(
// [SPARK-14205][SQL] remove trait Queryable
ProblemFilters.exclude[MissingTypesProblem]("org.apache.spark.sql.Dataset")
+ ) ++ Seq(
+ // [SPARK-11262][ML] Unit test for gradient, loss layers, memory management
+ // for multilayer perceptron.
+ // This class is marked as `private`.
+ ProblemFilters.exclude[MissingClassProblem]("org.apache.spark.ml.ann.SoftmaxFunction")
)
case v if v.startsWith("1.6") =>
Seq(