diff options
| author | Feynman Liang <fliang@databricks.com> | 2015-07-22 15:07:05 -0700 |
|---|---|---|
| committer | Joseph K. Bradley <joseph@databricks.com> | 2015-07-22 15:07:05 -0700 |
| commit | 1aca9c13c144fa336af6afcfa666128bf77c49d4 (patch) | |
| tree | 2aa5166485e6b1611e0aac216fbb3530003b718c /repl/scala-2.10 | |
| parent | cf21d05f8b5fae52b118fb8846f43d6fda1aea41 (diff) | |
| download | spark-1aca9c13c144fa336af6afcfa666128bf77c49d4.tar.gz spark-1aca9c13c144fa336af6afcfa666128bf77c49d4.tar.bz2 spark-1aca9c13c144fa336af6afcfa666128bf77c49d4.zip | |
[SPARK-8536] [MLLIB] Generalize OnlineLDAOptimizer to asymmetric document-topic Dirichlet priors
Modify `LDA` to take asymmetric document-topic prior distributions and `OnlineLDAOptimizer` to use the asymmetric prior during variational inference.
This PR only generalizes `OnlineLDAOptimizer` and the associated `LocalLDAModel`; `EMLDAOptimizer` and `DistributedLDAModel` still only support symmetric `alpha` (checked during `EMLDAOptimizer.initialize`).
Author: Feynman Liang <fliang@databricks.com>
Closes #7575 from feynmanliang/SPARK-8536-LDA-asymmetric-priors and squashes the following commits:
af8fbb7 [Feynman Liang] Fix merge errors
ef5821d [Feynman Liang] Merge remote-tracking branch 'apache/master' into SPARK-8536-LDA-asymmetric-priors
58f1d7b [Feynman Liang] Fix from review feedback
a6dcf70 [Feynman Liang] Change docConcentration interface and move LDAOptimizer validation to initialize, add sad path tests
72038ff [Feynman Liang] Add tests referenced against gensim
d4284fa [Feynman Liang] Generalize OnlineLDA to asymmetric priors, no tests
Diffstat (limited to 'repl/scala-2.10')
0 files changed, 0 insertions, 0 deletions