diff options
author | Mahmoud Rawas <mhmoudr@gmail.com> | 2016-06-29 13:12:17 +0100 |
---|---|---|
committer | Sean Owen <sowen@cloudera.com> | 2016-06-29 13:12:17 +0100 |
commit | 393db655c3c43155305fbba1b2f8c48a95f18d93 (patch) | |
tree | 109640f22c85ac6803be334548492687b31aa07f /.gitignore | |
parent | 21385d02a987bcee1198103e447c019f7a769d68 (diff) | |
download | spark-393db655c3c43155305fbba1b2f8c48a95f18d93.tar.gz spark-393db655c3c43155305fbba1b2f8c48a95f18d93.tar.bz2 spark-393db655c3c43155305fbba1b2f8c48a95f18d93.zip |
[SPARK-15858][ML] Fix calculating error by tree stack over flow prob…
## What changes were proposed in this pull request?
What changes were proposed in this pull request?
Improving evaluateEachIteration function in mllib as it fails when trying to calculate error by tree for a model that has more than 500 trees
## How was this patch tested?
the batch tested on productions data set (2K rows x 2K features) training a gradient boosted model without validation with 1000 maxIteration settings, then trying to produce the error by tree, the new patch was able to perform the calculation within 30 seconds, while previously it was take hours then fail.
**PS**: It would be better if this PR can be cherry picked into release branches 1.6.1 and 2.0
Author: Mahmoud Rawas <mhmoudr@gmail.com>
Author: Mahmoud Rawas <Mahmoud.Rawas@quantium.com.au>
Closes #13624 from mhmoudr/SPARK-15858.master.
Diffstat (limited to '.gitignore')
0 files changed, 0 insertions, 0 deletions