diff options
| author | Doris Xin <doris.s.xin@gmail.com> | 2014-07-27 16:16:39 -0700 |
|---|---|---|
| committer | Xiangrui Meng <meng@databricks.com> | 2014-07-27 16:16:39 -0700 |
| commit | 81fcdd22c8ef52889ed51b3ec5c2747708505fc2 (patch) | |
| tree | 503582e9268d5abccc95b186b5fd59292094524b /assembly | |
| parent | ecf30ee7e78ea59c462c54db0fde5328f997466c (diff) | |
| download | spark-81fcdd22c8ef52889ed51b3ec5c2747708505fc2.tar.gz spark-81fcdd22c8ef52889ed51b3ec5c2747708505fc2.tar.bz2 spark-81fcdd22c8ef52889ed51b3ec5c2747708505fc2.zip | |
[SPARK-2514] [mllib] Random RDD generator
Utilities for generating random RDDs.
RandomRDD and RandomVectorRDD are created instead of using `sc.parallelize(range:Range)` because `Range` objects in Scala can only have `size <= Int.MaxValue`.
The object `RandomRDDGenerators` can be transformed into a generator class to reduce the number of auxiliary methods for optional arguments.
Author: Doris Xin <doris.s.xin@gmail.com>
Closes #1520 from dorx/randomRDD and squashes the following commits:
01121ac [Doris Xin] reviewer comments
6bf27d8 [Doris Xin] Merge branch 'master' into randomRDD
a8ea92d [Doris Xin] Reviewer comments
063ea0b [Doris Xin] Merge branch 'master' into randomRDD
aec68eb [Doris Xin] newline
bc90234 [Doris Xin] units passed.
d56cacb [Doris Xin] impl with RandomRDD
92d6f1c [Doris Xin] solution for Cloneable
df5bcff [Doris Xin] Merge branch 'generator' into randomRDD
f46d928 [Doris Xin] WIP
49ed20d [Doris Xin] alternative poisson distribution generator
7cb0e40 [Doris Xin] fix for data inconsistency
8881444 [Doris Xin] RandomRDDGenerator: initial design
Diffstat (limited to 'assembly')
0 files changed, 0 insertions, 0 deletions