diff options
| author | Matei Zaharia <matei@eecs.berkeley.edu> | 2012-08-03 16:44:17 -0400 |
|---|---|---|
| committer | Matei Zaharia <matei@eecs.berkeley.edu> | 2012-08-03 16:46:48 -0400 |
| commit | 62898b631fe6584ff93e62948765f7101304ebfa (patch) | |
| tree | 3c351c3f91f69033c358a3fe8a5e40665ee5c83c /core/src/test/scala | |
| parent | 6601a6212b65fcd40a0158a6f1df28ae958bbd9e (diff) | |
| download | spark-62898b631fe6584ff93e62948765f7101304ebfa.tar.gz spark-62898b631fe6584ff93e62948765f7101304ebfa.tar.bz2 spark-62898b631fe6584ff93e62948765f7101304ebfa.zip | |
Made range partition balance tests more aggressive.
This is because we pull out such a large sample (10x the number of
partitions) that we should expect pretty good balance. The tests are
also deterministic so there's no worry about them failing irreproducibly.
Diffstat (limited to 'core/src/test/scala')
| -rw-r--r-- | core/src/test/scala/spark/SortingSuite.scala | 16 |
1 files changed, 8 insertions, 8 deletions
diff --git a/core/src/test/scala/spark/SortingSuite.scala b/core/src/test/scala/spark/SortingSuite.scala index a6fdd8a218..8fa1442a4d 100644 --- a/core/src/test/scala/spark/SortingSuite.scala +++ b/core/src/test/scala/spark/SortingSuite.scala @@ -59,10 +59,10 @@ class SortingSuite extends FunSuite with BeforeAndAfter with ShouldMatchers with assert(sorted.collect() === pairArr.sortBy(_._1)) val partitions = sorted.collectPartitions() logInfo("partition lengths: " + partitions.map(_.length).mkString(", ")) - partitions(0).length should be > 150 - partitions(1).length should be > 150 - partitions(2).length should be > 150 - partitions(3).length should be > 150 + partitions(0).length should be > 200 + partitions(1).length should be > 200 + partitions(2).length should be > 200 + partitions(3).length should be > 200 partitions(0).last should be < partitions(1).head partitions(1).last should be < partitions(2).head partitions(2).last should be < partitions(3).head @@ -75,10 +75,10 @@ class SortingSuite extends FunSuite with BeforeAndAfter with ShouldMatchers with assert(sorted.collect() === pairArr.sortBy(_._1).reverse) val partitions = sorted.collectPartitions() logInfo("partition lengths: " + partitions.map(_.length).mkString(", ")) - partitions(0).length should be > 150 - partitions(1).length should be > 150 - partitions(2).length should be > 150 - partitions(3).length should be > 150 + partitions(0).length should be > 200 + partitions(1).length should be > 200 + partitions(2).length should be > 200 + partitions(3).length should be > 200 partitions(0).last should be > partitions(1).head partitions(1).last should be > partitions(2).head partitions(2).last should be > partitions(3).head |