diff options
| author | Xiangrui Meng <meng@databricks.com> | 2014-08-13 23:53:44 -0700 |
|---|---|---|
| committer | Xiangrui Meng <meng@databricks.com> | 2014-08-13 23:53:44 -0700 |
| commit | 69a57a18ee35af1cc5a00b67a80837ea317cd330 (patch) | |
| tree | 54278115209e26975fb3db832a32d629f6c419e4 /docs/configuration.md | |
| parent | e4245656438d00714ebd59e89c4de3fdaae83494 (diff) | |
| download | spark-69a57a18ee35af1cc5a00b67a80837ea317cd330.tar.gz spark-69a57a18ee35af1cc5a00b67a80837ea317cd330.tar.bz2 spark-69a57a18ee35af1cc5a00b67a80837ea317cd330.zip | |
[SPARK-2995][MLLIB] add ALS.setIntermediateRDDStorageLevel
As mentioned in SPARK-2465, using `MEMORY_AND_DISK_SER` for user/product in/out links together with `spark.rdd.compress=true` can help reduce the space requirement by a lot, at the cost of speed. It might be useful to add this option so people can run ALS on much bigger datasets.
Another option for the method name is `setIntermediateRDDStorageLevel`.
Author: Xiangrui Meng <meng@databricks.com>
Closes #1913 from mengxr/als-storagelevel and squashes the following commits:
d942017 [Xiangrui Meng] rename to setIntermediateRDDStorageLevel
7550029 [Xiangrui Meng] add ALS.setIntermediateDataStorageLevel
Diffstat (limited to 'docs/configuration.md')
0 files changed, 0 insertions, 0 deletions