diff options
| author | Xiangrui Meng <meng@databricks.com> | 2015-03-20 15:02:57 -0400 |
|---|---|---|
| committer | Xiangrui Meng <meng@databricks.com> | 2015-03-20 15:02:57 -0400 |
| commit | 6b36470c66bd6140c45e45d3f1d51b0082c3fd97 (patch) | |
| tree | 2887dd51713f682e1a0e40bfef6b359a3a3e4609 /docs/running-on-mesos.md | |
| parent | 25636d9867c6bc901463b6b227cb444d701cfdd1 (diff) | |
| download | spark-6b36470c66bd6140c45e45d3f1d51b0082c3fd97.tar.gz spark-6b36470c66bd6140c45e45d3f1d51b0082c3fd97.tar.bz2 spark-6b36470c66bd6140c45e45d3f1d51b0082c3fd97.zip | |
[SPARK-5955][MLLIB] add checkpointInterval to ALS
Add checkpiontInterval to ALS to prevent:
1. StackOverflow exceptions caused by long lineage,
2. large shuffle files generated during iterations,
3. slow recovery when some node fail.
srowen coderxiang
Author: Xiangrui Meng <meng@databricks.com>
Closes #5076 from mengxr/SPARK-5955 and squashes the following commits:
df56791 [Xiangrui Meng] update impl to reuse code
29affcb [Xiangrui Meng] do not materialize factors in implicit
20d3f7f [Xiangrui Meng] add checkpointInterval to ALS
Diffstat (limited to 'docs/running-on-mesos.md')
0 files changed, 0 insertions, 0 deletions