diff options
| author | Patrick Wendell <pwendell@gmail.com> | 2014-01-13 12:18:05 -0800 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-01-13 12:18:05 -0800 |
| commit | b93f9d42f21f03163734ef97b2871db945e166da (patch) | |
| tree | ec06b7bd5e6dd7c61061995c94f8d75661c58918 /docs | |
| parent | e6ed13f255d70de422711b979447690cdab7423b (diff) | |
| parent | ffa1d38ef19a7d5c5c2fc173d1d2f54267449f80 (diff) | |
| download | spark-b93f9d42f21f03163734ef97b2871db945e166da.tar.gz spark-b93f9d42f21f03163734ef97b2871db945e166da.tar.bz2 spark-b93f9d42f21f03163734ef97b2871db945e166da.zip | |
Merge pull request #400 from tdas/dstream-move
Moved DStream and PairDSream to org.apache.spark.streaming.dstream
Similar to the package location of `org.apache.spark.rdd.RDD`, `DStream` has been moved from `org.apache.spark.streaming.DStream` to `org.apache.spark.streaming.dstream.DStream`. I know that the package name is a little long, but I think its better to keep it consistent with Spark's structure.
Also fixed persistence of windowed DStream. The RDDs generated generated by windowed DStream are essentially unions of underlying RDDs, and persistent these union RDDs would store numerous copies of the underlying data. Instead setting the persistence level on the windowed DStream is made to set the persistence level of the underlying DStream.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/streaming-programming-guide.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md index 3273817c78..4e8a680a75 100644 --- a/docs/streaming-programming-guide.md +++ b/docs/streaming-programming-guide.md @@ -167,7 +167,7 @@ Spark Streaming features windowed computations, which allow you to apply transfo </tr> </table> -A complete list of DStream operations is available in the API documentation of [DStream](api/streaming/index.html#org.apache.spark.streaming.DStream) and [PairDStreamFunctions](api/streaming/index.html#org.apache.spark.streaming.PairDStreamFunctions). +A complete list of DStream operations is available in the API documentation of [DStream](api/streaming/index.html#org.apache.spark.streaming.dstream.DStream) and [PairDStreamFunctions](api/streaming/index.html#org.apache.spark.streaming.dstream.PairDStreamFunctions). ## Output Operations When an output operator is called, it triggers the computation of a stream. Currently the following output operators are defined: |