diff options
| author | Burak Yavuz <brkyvz@gmail.com> | 2015-04-30 21:56:03 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-04-30 21:56:03 -0700 |
| commit | b5347a4664625ede6ab9d8ef6558457a34ae423f (patch) | |
| tree | 6d068b5ede427fa4e4658d5d3ebcd9798c64950f /sql/core/src/test/java | |
| parent | 69a739c7f5fd002432ece203957e1458deb2f4c3 (diff) | |
| download | spark-b5347a4664625ede6ab9d8ef6558457a34ae423f.tar.gz spark-b5347a4664625ede6ab9d8ef6558457a34ae423f.tar.bz2 spark-b5347a4664625ede6ab9d8ef6558457a34ae423f.zip | |
[SPARK-7248] implemented random number generators for DataFrames
Adds the functions `rand` (Uniform Dist) and `randn` (Normal Dist.) as expressions to DataFrames.
cc mengxr rxin
Author: Burak Yavuz <brkyvz@gmail.com>
Closes #5819 from brkyvz/df-rng and squashes the following commits:
50d69d4 [Burak Yavuz] add seed for test that failed
4234c3a [Burak Yavuz] fix Rand expression
13cad5c [Burak Yavuz] couple fixes
7d53953 [Burak Yavuz] waiting for hive tests
b453716 [Burak Yavuz] move radn with seed down
03637f0 [Burak Yavuz] fix broken hive func
c5909eb [Burak Yavuz] deleted old implementation of Rand
6d43895 [Burak Yavuz] implemented random generators
Diffstat (limited to 'sql/core/src/test/java')
| -rw-r--r-- | sql/core/src/test/java/test/org/apache/spark/sql/JavaDataFrameSuite.java | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/sql/core/src/test/java/test/org/apache/spark/sql/JavaDataFrameSuite.java b/sql/core/src/test/java/test/org/apache/spark/sql/JavaDataFrameSuite.java index 966d879e1f..ebe96e649d 100644 --- a/sql/core/src/test/java/test/org/apache/spark/sql/JavaDataFrameSuite.java +++ b/sql/core/src/test/java/test/org/apache/spark/sql/JavaDataFrameSuite.java @@ -104,6 +104,9 @@ public class JavaDataFrameSuite { df2.select(pow("a", "a"), pow("b", 2.0)); df2.select(pow(col("a"), col("b")), exp("b")); df2.select(sin("a"), acos("b")); + + df2.select(rand(), acos("b")); + df2.select(col("*"), randn(5L)); } @Ignore |