diff options
| author | Vinod K C <vinod.kc@huawei.com> | 2015-05-09 10:03:15 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-05-09 10:03:15 +0100 |
| commit | dda6d9f4045fa2d1265abffa9d7dbdc967448417 (patch) | |
| tree | cff2d6a2034b32f4dc71ba2f2927fb90a1cd1dda /core/src/test | |
| parent | 29926238418223b0888d418d163feebf0217b35e (diff) | |
| download | spark-dda6d9f4045fa2d1265abffa9d7dbdc967448417.tar.gz spark-dda6d9f4045fa2d1265abffa9d7dbdc967448417.tar.bz2 spark-dda6d9f4045fa2d1265abffa9d7dbdc967448417.zip | |
[SPARK-7438] [SPARK CORE] Fixed validation of relativeSD in countApproxDistinct
Author: Vinod K C <vinod.kc@huawei.com>
Closes #5974 from vinodkc/fix_countApproxDistinct_Validation and squashes the following commits:
3a3d59c [Vinod K C] Reverted removal of validation relativeSD<0.000017
799976e [Vinod K C] Removed testcase to assert IAE when relativeSD>3.7
8ddbfae [Vinod K C] Remove blank line
b1b00a3 [Vinod K C] Removed relativeSD validation from python API,RDD.scala will do validation
122d378 [Vinod K C] Fixed validation of relativeSD in countApproxDistinct
Diffstat (limited to 'core/src/test')
| -rw-r--r-- | core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala b/core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala index ef8c36a286..afc11bdc4d 100644 --- a/core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala +++ b/core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala @@ -89,6 +89,8 @@ class RDDSuite extends FunSuite with SharedSparkContext { val simpleRdd = sc.makeRDD(uniformDistro, 10) assert(error(simpleRdd.countApproxDistinct(8, 0), size) < 0.2) assert(error(simpleRdd.countApproxDistinct(12, 0), size) < 0.1) + assert(error(simpleRdd.countApproxDistinct(0.02), size) < 0.1) + assert(error(simpleRdd.countApproxDistinct(0.5), size) < 0.22) } test("SparkContext.union") { |