diff options
| author | hqzizania <hqzizania@gmail.com> | 2016-08-20 18:52:44 -0700 |
|---|---|---|
| committer | DB Tsai <dbt@netflix.com> | 2016-08-20 18:52:44 -0700 |
| commit | 61ef74f2272faa7ce8f2badc7e00039908e3551f (patch) | |
| tree | e6e39f47aea0f9a4e45e47b1d9ccabe465b32ff0 /R/pkg/inst/tests/testthat/test_mllib.R | |
| parent | 9f37d4eac28dd179dd523fa7d645be97bb52af9c (diff) | |
| download | spark-61ef74f2272faa7ce8f2badc7e00039908e3551f.tar.gz spark-61ef74f2272faa7ce8f2badc7e00039908e3551f.tar.bz2 spark-61ef74f2272faa7ce8f2badc7e00039908e3551f.zip | |
[SPARK-17090][ML] Make tree aggregation level in linear/logistic regression configurable
## What changes were proposed in this pull request?
Linear/logistic regression use treeAggregate with default depth (always = 2) for collecting coefficient gradient updates to the driver. For high dimensional problems, this can cause OOM error on the driver. This patch makes it configurable to avoid this problem if users' input data has many features. It adds a HasTreeDepth API in `sharedParams.scala`, and extends it to both Linear regression and logistic regression in .ml
Author: hqzizania <hqzizania@gmail.com>
Closes #14717 from hqzizania/SPARK-17090.
Diffstat (limited to 'R/pkg/inst/tests/testthat/test_mllib.R')
0 files changed, 0 insertions, 0 deletions