diff options
| author | Wesley Tang <tangmingjun@mininglamp.com> | 2016-03-16 16:12:17 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2016-03-16 16:12:17 +0000 |
| commit | 5f6bdf97c5d2d78db0ca39703084d8ae377346b8 (patch) | |
| tree | 7c1fa312e8d99bec4f3aae393d6ecbbf145bf7ce /core/src/test/scala/org/apache | |
| parent | 9412547e7a58c40e7be5acacaf15cc48057cb18a (diff) | |
| download | spark-5f6bdf97c5d2d78db0ca39703084d8ae377346b8.tar.gz spark-5f6bdf97c5d2d78db0ca39703084d8ae377346b8.tar.bz2 spark-5f6bdf97c5d2d78db0ca39703084d8ae377346b8.zip | |
[SPARK-13281][CORE] Switch broadcast of RDD to exception from warning
## What changes were proposed in this pull request?
In SparkContext, throw Illegalargumentexception when trying to broadcast rdd directly, instead of logging the warning.
## How was this patch tested?
mvn clean install
Add UT in BroadcastSuite
Author: Wesley Tang <tangmingjun@mininglamp.com>
Closes #11735 from breakdawn/master.
Diffstat (limited to 'core/src/test/scala/org/apache')
| -rw-r--r-- | core/src/test/scala/org/apache/spark/broadcast/BroadcastSuite.scala | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/core/src/test/scala/org/apache/spark/broadcast/BroadcastSuite.scala b/core/src/test/scala/org/apache/spark/broadcast/BroadcastSuite.scala index f97cfbba32..6657104823 100644 --- a/core/src/test/scala/org/apache/spark/broadcast/BroadcastSuite.scala +++ b/core/src/test/scala/org/apache/spark/broadcast/BroadcastSuite.scala @@ -130,6 +130,13 @@ class BroadcastSuite extends SparkFunSuite with LocalSparkContext { assert(thrown.getMessage.toLowerCase.contains("stopped")) } + test("Forbid broadcasting RDD directly") { + sc = new SparkContext(new SparkConf().setAppName("test").setMaster("local")) + val rdd = sc.parallelize(1 to 4) + intercept[IllegalArgumentException] { sc.broadcast(rdd) } + sc.stop() + } + /** * Verify the persistence of state associated with an TorrentBroadcast in a local-cluster. * |