diff options
author | CodingCat <zhunansjtu@gmail.com> | 2014-05-30 22:06:08 -0700 |
---|---|---|
committer | Reynold Xin <rxin@apache.org> | 2014-05-30 22:06:52 -0700 |
commit | 3faa084fffdae559839af13a6c0e4c39ac81338f (patch) | |
tree | d170daf1236ab8aec71e0b592c8c42e85908dc4d | |
parent | 4b12737af73001f488530f8ae558445e90e4183f (diff) | |
download | spark-3faa084fffdae559839af13a6c0e4c39ac81338f.tar.gz spark-3faa084fffdae559839af13a6c0e4c39ac81338f.tar.bz2 spark-3faa084fffdae559839af13a6c0e4c39ac81338f.zip |
SPARK-1976: fix the misleading part in streaming docs
Spark streaming requires at least two working threads, but the document gives the example like
import org.apache.spark.api.java.function._
import org.apache.spark.streaming._
import org.apache.spark.streaming.api._
// Create a StreamingContext with a local master
val ssc = new StreamingContext("local", "NetworkWordCount", Seconds(1))
http://spark.apache.org/docs/latest/streaming-programming-guide.html
Author: CodingCat <zhunansjtu@gmail.com>
Closes #924 from CodingCat/master and squashes the following commits:
bb89f20 [CodingCat] update streaming docs
(cherry picked from commit 41bfdda3cc53b44b0fb2105533b7c0e1a69eb3bb)
Signed-off-by: Reynold Xin <rxin@apache.org>
-rw-r--r-- | docs/streaming-programming-guide.md | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md index b95f818d0f..bbee67f54c 100644 --- a/docs/streaming-programming-guide.md +++ b/docs/streaming-programming-guide.md @@ -80,7 +80,8 @@ import org.apache.spark.api.java.function._ import org.apache.spark.streaming._ import org.apache.spark.streaming.api._ // Create a StreamingContext with a local master -val ssc = new StreamingContext("local", "NetworkWordCount", Seconds(1)) +// Spark Streaming needs at least two working thread +val ssc = new StreamingContext("local[2]", "NetworkWordCount", Seconds(1)) {% endhighlight %} Using this context, we then create a new DStream |