<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (version 1.7.0_51) on Wed Sep 16 10:26:36 PDT 2015 -->
<title>DStream</title>
<meta name="date" content="2015-09-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
</head>
<body>
<script type="text/javascript"><!--
if (location.href.indexOf('is-external=true') == -1) {
parent.document.title="DStream";
}
//-->
</script>
<noscript>
<div>JavaScript is disabled on your browser.</div>
</noscript>
<!-- ========= START OF TOP NAVBAR ======= -->
<div class="topNav"><a name="navbar_top">
<!-- -->
</a><a href="#skip-navbar_top" title="Skip navigation links"></a><a name="navbar_top_firstrow">
<!-- -->
</a>
<ul class="navList" title="Navigation">
<li><a href="../../../../../overview-summary.html">Overview</a></li>
<li><a href="package-summary.html">Package</a></li>
<li class="navBarCell1Rev">Class</li>
<li><a href="package-tree.html">Tree</a></li>
<li><a href="../../../../../deprecated-list.html">Deprecated</a></li>
<li><a href="../../../../../index-all.html">Index</a></li>
<li><a href="../../../../../help-doc.html">Help</a></li>
</ul>
</div>
<div class="subNav">
<ul class="navList">
<li><a href="../../../../../org/apache/spark/streaming/dstream/ConstantInputDStream.html" title="class in org.apache.spark.streaming.dstream"><span class="strong">Prev Class</span></a></li>
<li><a href="../../../../../org/apache/spark/streaming/dstream/InputDStream.html" title="class in org.apache.spark.streaming.dstream"><span class="strong">Next Class</span></a></li>
</ul>
<ul class="navList">
<li><a href="../../../../../index.html?org/apache/spark/streaming/dstream/DStream.html" target="_top">Frames</a></li>
<li><a href="DStream.html" target="_top">No Frames</a></li>
</ul>
<ul class="navList" id="allclasses_navbar_top">
<li><a href="../../../../../allclasses-noframe.html">All Classes</a></li>
</ul>
<div>
<script type="text/javascript"><!--
allClassesLink = document.getElementById("allclasses_navbar_top");
if(window==top) {
allClassesLink.style.display = "block";
}
else {
allClassesLink.style.display = "none";
}
//-->
</script>
</div>
<div>
<ul class="subNavList">
<li>Summary: </li>
<li>Nested | </li>
<li>Field | </li>
<li><a href="#constructor_summary">Constr</a> | </li>
<li><a href="#method_summary">Method</a></li>
</ul>
<ul class="subNavList">
<li>Detail: </li>
<li>Field | </li>
<li><a href="#constructor_detail">Constr</a> | </li>
<li><a href="#method_detail">Method</a></li>
</ul>
</div>
<a name="skip-navbar_top">
<!-- -->
</a></div>
<!-- ========= END OF TOP NAVBAR ========= -->
<!-- ======== START OF CLASS DATA ======== -->
<div class="header">
<div class="subTitle">org.apache.spark.streaming.dstream</div>
<h2 title="Class DStream" class="title">Class DStream<T></h2>
</div>
<div class="contentContainer">
<ul class="inheritance">
<li>java.lang.Object</li>
<li>
<ul class="inheritance">
<li>org.apache.spark.streaming.dstream.DStream<T></li>
</ul>
</li>
</ul>
<div class="description">
<ul class="blockList">
<li class="blockList">
<dl>
<dt>All Implemented Interfaces:</dt>
<dd>java.io.Serializable, <a href="../../../../../org/apache/spark/Logging.html" title="interface in org.apache.spark">Logging</a></dd>
</dl>
<dl>
<dt>Direct Known Subclasses:</dt>
<dd><a href="../../../../../org/apache/spark/streaming/dstream/InputDStream.html" title="class in org.apache.spark.streaming.dstream">InputDStream</a></dd>
</dl>
<hr>
<br>
<pre>public abstract class <span class="strong">DStream<T></span>
extends java.lang.Object
implements scala.Serializable, <a href="../../../../../org/apache/spark/Logging.html" title="interface in org.apache.spark">Logging</a></pre>
<div class="block">A Discretized Stream (DStream), the basic abstraction in Spark Streaming, is a continuous
sequence of RDDs (of the same type) representing a continuous stream of data (see
org.apache.spark.rdd.RDD in the Spark core documentation for more details on RDDs).
DStreams can either be created from live data (such as, data from TCP sockets, Kafka, Flume,
etc.) using a <a href="../../../../../org/apache/spark/streaming/StreamingContext.html" title="class in org.apache.spark.streaming"><code>StreamingContext</code></a> or it can be generated by
transforming existing DStreams using operations such as <code>map</code>,
<code>window</code> and <code>reduceByKeyAndWindow</code>. While a Spark Streaming program is running, each DStream
periodically generates a RDD, either from live data or by transforming the RDD generated by a
parent DStream.
<p>
This class contains the basic operations available on all DStreams, such as <code>map</code>, <code>filter</code> and
<code>window</code>. In addition, <a href="../../../../../org/apache/spark/streaming/dstream/PairDStreamFunctions.html" title="class in org.apache.spark.streaming.dstream"><code>PairDStreamFunctions</code></a> contains
operations available only on DStreams of key-value pairs, such as <code>groupByKeyAndWindow</code> and
<code>join</code>. These operations are automatically available on any DStream of pairs
(e.g., DStream[(Int, Int)] through implicit conversions.
<p>
DStreams internally is characterized by a few basic properties:
- A list of other DStreams that the DStream depends on
- A time interval at which the DStream generates an RDD
- A function that is used to generate an RDD after each time interval</div>
<dl><dt><span class="strong">See Also:</span></dt><dd><a href="../../../../../serialized-form.html#org.apache.spark.streaming.dstream.DStream">Serialized Form</a></dd></dl>
</li>
</ul>
</div>
<div class="summary">
<ul class="blockList">
<li class="blockList">
<!-- ======== CONSTRUCTOR SUMMARY ======== -->
<ul class="blockList">
<li class="blockList"><a name="constructor_summary">
<!-- -->
</a>
<h3>Constructor Summary</h3>
<table class="overviewSummary" border="0" cellpadding="3" cellspacing="0" summary="Constructor Summary table, listing constructors, and an explanation">
<caption><span>Constructors</span><span class="tabEnd"> </span></caption>
<tr>
<th class="colOne" scope="col">Constructor and Description</th>
</tr>
<tr class="altColor">
<td class="colOne"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#DStream(org.apache.spark.streaming.StreamingContext, scala.reflect.ClassTag)">DStream</a></strong>(<a href="../../../../../org/apache/spark/streaming/StreamingContext.html" title="class in org.apache.spark.streaming">StreamingContext</a> ssc,
scala.reflect.ClassTag<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> evidence$1)</code> </td>
</tr>
</table>
</li>
</ul>
<!-- ========== METHOD SUMMARY =========== -->
<ul class="blockList">
<li class="blockList"><a name="method_summary">
<!-- -->
</a>
<h3>Method Summary</h3>
<table class="overviewSummary" border="0" cellpadding="3" cellspacing="0" summary="Method Summary table, listing methods, and an explanation">
<caption><span>Methods</span><span class="tabEnd"> </span></caption>
<tr>
<th class="colFirst" scope="col">Modifier and Type</th>
<th class="colLast" scope="col">Method and Description</th>
</tr>
<tr class="altColor">
<td class="colFirst"><code>protected scala.Option<java.lang.String></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#baseScope()">baseScope</a></strong>()</code>
<div class="block">The base scope associated with the operation that created this DStream.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#cache()">cache</a></strong>()</code>
<div class="block">Persist RDDs of this DStream with the default storage level (MEMORY_ONLY_SER)</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#checkpoint(org.apache.spark.streaming.Duration)">checkpoint</a></strong>(<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> interval)</code>
<div class="block">Enable periodic checkpointing of RDDs of this DStream</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code>org.apache.spark.streaming.dstream.DStreamCheckpointData<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#checkpointData()">checkpointData</a></strong>()</code> </td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#checkpointDuration()">checkpointDuration</a></strong>()</code> </td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code>abstract scala.Option<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#compute(org.apache.spark.streaming.Time)">compute</a></strong>(<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a> validTime)</code>
<div class="block">Method that generates a RDD for the given time</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/StreamingContext.html" title="class in org.apache.spark.streaming">StreamingContext</a></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#context()">context</a></strong>()</code>
<div class="block">Return the StreamingContext associated with this DStream</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><java.lang.Object></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#count()">count</a></strong>()</code>
<div class="block">Return a new DStream in which each RDD has a single element generated by counting each RDD
of this DStream.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><scala.Tuple2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,java.lang.Object>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#countByValue(int, scala.math.Ordering)">countByValue</a></strong>(int numPartitions,
scala.math.Ordering<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> ord)</code>
<div class="block">Return a new DStream in which each RDD contains the counts of each distinct value in
each RDD of this DStream.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><scala.Tuple2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,java.lang.Object>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#countByValueAndWindow(org.apache.spark.streaming.Duration, org.apache.spark.streaming.Duration, int, scala.math.Ordering)">countByValueAndWindow</a></strong>(<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> slideDuration,
int numPartitions,
scala.math.Ordering<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> ord)</code>
<div class="block">Return a new DStream in which each RDD contains the count of distinct elements in
RDDs in a sliding window over this DStream.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><java.lang.Object></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#countByWindow(org.apache.spark.streaming.Duration, org.apache.spark.streaming.Duration)">countByWindow</a></strong>(<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> slideDuration)</code>
<div class="block">Return a new DStream in which each RDD has a single element generated by counting the number
of elements in a sliding window over this DStream.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code>protected <U> U</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#createRDDWithLocalProperties(org.apache.spark.streaming.Time, scala.Function0)">createRDDWithLocalProperties</a></strong>(<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a> time,
scala.Function0<U> body)</code>
<div class="block">Wrap a body of code such that the call site and operation scope
information are passed to the RDDs created in this body properly.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code>org.apache.spark.util.CallSite</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#creationSite()">creationSite</a></strong>()</code> </td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code>abstract scala.collection.immutable.List<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><?>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#dependencies()">dependencies</a></strong>()</code>
<div class="block">List of parent DStreams on which this DStream depends on</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#filter(scala.Function1)">filter</a></strong>(scala.Function1<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,java.lang.Object> filterFunc)</code>
<div class="block">Return a new DStream containing only the elements that satisfy a predicate.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><U> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#flatMap(scala.Function1, scala.reflect.ClassTag)">flatMap</a></strong>(scala.Function1<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,scala.collection.Traversable<U>> flatMapFunc,
scala.reflect.ClassTag<U> evidence$3)</code>
<div class="block">Return a new DStream by applying a function to all elements of this DStream,
and then flattening the results</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code>void</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#foreach(scala.Function1)">foreach</a></strong>(scala.Function1<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,scala.runtime.BoxedUnit> foreachFunc)</code>
<div class="block"><strong>Deprecated.</strong>
<div class="block"><i>As of 0.9.0, replaced by <code>foreachRDD</code>.</i></div>
</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code>void</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#foreach(scala.Function2)">foreach</a></strong>(scala.Function2<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a>,scala.runtime.BoxedUnit> foreachFunc)</code>
<div class="block"><strong>Deprecated.</strong>
<div class="block"><i>As of 0.9.0, replaced by <code>foreachRDD</code>.</i></div>
</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code>void</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#foreachRDD(scala.Function1)">foreachRDD</a></strong>(scala.Function1<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,scala.runtime.BoxedUnit> foreachFunc)</code>
<div class="block">Apply a function to each RDD in this DStream.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code>void</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#foreachRDD(scala.Function2)">foreachRDD</a></strong>(scala.Function2<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a>,scala.runtime.BoxedUnit> foreachFunc)</code>
<div class="block">Apply a function to each RDD in this DStream.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code>scala.collection.mutable.HashMap<<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#generatedRDDs()">generatedRDDs</a></strong>()</code> </td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><java.lang.Object></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#glom()">glom</a></strong>()</code>
<div class="block">Return a new DStream in which each RDD is generated by applying glom() to each RDD of
this DStream.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code>org.apache.spark.streaming.DStreamGraph</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#graph()">graph</a></strong>()</code> </td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><U> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#map(scala.Function1, scala.reflect.ClassTag)">map</a></strong>(scala.Function1<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,U> mapFunc,
scala.reflect.ClassTag<U> evidence$2)</code>
<div class="block">Return a new DStream by applying a function to all elements of this DStream.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><U> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#mapPartitions(scala.Function1, boolean, scala.reflect.ClassTag)">mapPartitions</a></strong>(scala.Function1<scala.collection.Iterator<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,scala.collection.Iterator<U>> mapPartFunc,
boolean preservePartitioning,
scala.reflect.ClassTag<U> evidence$4)</code>
<div class="block">Return a new DStream in which each RDD is generated by applying mapPartitions() to each RDDs
of this DStream.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code>boolean</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#mustCheckpoint()">mustCheckpoint</a></strong>()</code> </td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#persist()">persist</a></strong>()</code>
<div class="block">Persist RDDs of this DStream with the default storage level (MEMORY_ONLY_SER)</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#persist(org.apache.spark.storage.StorageLevel)">persist</a></strong>(<a href="../../../../../org/apache/spark/storage/StorageLevel.html" title="class in org.apache.spark.storage">StorageLevel</a> level)</code>
<div class="block">Persist the RDDs of this DStream with the given storage level</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code>void</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#print()">print</a></strong>()</code>
<div class="block">Print the first ten elements of each RDD generated in this DStream.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code>void</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#print(int)">print</a></strong>(int num)</code>
<div class="block">Print the first num elements of each RDD generated in this DStream.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#reduce(scala.Function2)">reduce</a></strong>(scala.Function2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> reduceFunc)</code>
<div class="block">Return a new DStream in which each RDD has a single element generated by reducing each RDD
of this DStream.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#reduceByWindow(scala.Function2, org.apache.spark.streaming.Duration, org.apache.spark.streaming.Duration)">reduceByWindow</a></strong>(scala.Function2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> reduceFunc,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> slideDuration)</code>
<div class="block">Return a new DStream in which each RDD has a single element generated by reducing all
elements in a sliding window over this DStream.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#reduceByWindow(scala.Function2, scala.Function2, org.apache.spark.streaming.Duration, org.apache.spark.streaming.Duration)">reduceByWindow</a></strong>(scala.Function2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> reduceFunc,
scala.Function2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> invReduceFunc,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> slideDuration)</code>
<div class="block">Return a new DStream in which each RDD has a single element generated by reducing all
elements in a sliding window over this DStream.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#rememberDuration()">rememberDuration</a></strong>()</code> </td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#repartition(int)">repartition</a></strong>(int numPartitions)</code>
<div class="block">Return a new DStream with an increased or decreased level of parallelism.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code>void</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#saveAsObjectFiles(java.lang.String, java.lang.String)">saveAsObjectFiles</a></strong>(java.lang.String prefix,
java.lang.String suffix)</code>
<div class="block">Save each RDD in this DStream as a Sequence file of serialized objects.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code>void</code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#saveAsTextFiles(java.lang.String, java.lang.String)">saveAsTextFiles</a></strong>(java.lang.String prefix,
java.lang.String suffix)</code>
<div class="block">Save each RDD in this DStream as at text file, using string representation
of elements.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code>scala.collection.Seq<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#slice(org.apache.spark.streaming.Interval)">slice</a></strong>(org.apache.spark.streaming.Interval interval)</code>
<div class="block">Return all the RDDs defined by the Interval object (both end times included)</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code>scala.collection.Seq<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#slice(org.apache.spark.streaming.Time, org.apache.spark.streaming.Time)">slice</a></strong>(<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a> fromTime,
<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a> toTime)</code>
<div class="block">Return all the RDDs between 'fromTime' to 'toTime' (both included)</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code>abstract <a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#slideDuration()">slideDuration</a></strong>()</code>
<div class="block">Time interval after which the DStream generates a RDD</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/StreamingContext.html" title="class in org.apache.spark.streaming">StreamingContext</a></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#ssc()">ssc</a></strong>()</code> </td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/storage/StorageLevel.html" title="class in org.apache.spark.storage">StorageLevel</a></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#storageLevel()">storageLevel</a></strong>()</code> </td>
</tr>
<tr class="altColor">
<td class="colFirst"><code>static <K,V> <a href="../../../../../org/apache/spark/streaming/dstream/PairDStreamFunctions.html" title="class in org.apache.spark.streaming.dstream">PairDStreamFunctions</a><K,V></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#toPairDStreamFunctions(org.apache.spark.streaming.dstream.DStream, scala.reflect.ClassTag, scala.reflect.ClassTag, scala.math.Ordering)">toPairDStreamFunctions</a></strong>(<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><scala.Tuple2<K,V>> stream,
scala.reflect.ClassTag<K> kt,
scala.reflect.ClassTag<V> vt,
scala.math.Ordering<K> ord)</code> </td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><U> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#transform(scala.Function1, scala.reflect.ClassTag)">transform</a></strong>(scala.Function1<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><U>> transformFunc,
scala.reflect.ClassTag<U> evidence$5)</code>
<div class="block">Return a new DStream in which each RDD is generated by applying a function
on each RDD of 'this' DStream.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><U> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#transform(scala.Function2, scala.reflect.ClassTag)">transform</a></strong>(scala.Function2<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><U>> transformFunc,
scala.reflect.ClassTag<U> evidence$6)</code>
<div class="block">Return a new DStream in which each RDD is generated by applying a function
on each RDD of 'this' DStream.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><U,V> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><V></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#transformWith(org.apache.spark.streaming.dstream.DStream, scala.Function2, scala.reflect.ClassTag, scala.reflect.ClassTag)">transformWith</a></strong>(<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U> other,
scala.Function2<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><U>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><V>> transformFunc,
scala.reflect.ClassTag<U> evidence$7,
scala.reflect.ClassTag<V> evidence$8)</code>
<div class="block">Return a new DStream in which each RDD is generated by applying a function
on each RDD of 'this' DStream and 'other' DStream.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><U,V> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><V></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#transformWith(org.apache.spark.streaming.dstream.DStream, scala.Function3, scala.reflect.ClassTag, scala.reflect.ClassTag)">transformWith</a></strong>(<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U> other,
scala.Function3<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><U>,<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><V>> transformFunc,
scala.reflect.ClassTag<U> evidence$9,
scala.reflect.ClassTag<V> evidence$10)</code>
<div class="block">Return a new DStream in which each RDD is generated by applying a function
on each RDD of 'this' DStream and 'other' DStream.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#union(org.apache.spark.streaming.dstream.DStream)">union</a></strong>(<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> that)</code>
<div class="block">Return a new DStream by unifying data of another DStream with this DStream.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#window(org.apache.spark.streaming.Duration)">window</a></strong>(<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration)</code>
<div class="block">Return a new DStream in which each RDD contains all the elements in seen in a
sliding window of time over this DStream.</div>
</td>
</tr>
<tr class="rowColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#window(org.apache.spark.streaming.Duration, org.apache.spark.streaming.Duration)">window</a></strong>(<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> slideDuration)</code>
<div class="block">Return a new DStream in which each RDD contains all the elements in seen in a
sliding window of time over this DStream.</div>
</td>
</tr>
<tr class="altColor">
<td class="colFirst"><code><a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a></code></td>
<td class="colLast"><code><strong><a href="../../../../../org/apache/spark/streaming/dstream/DStream.html#zeroTime()">zeroTime</a></strong>()</code> </td>
</tr>
</table>
<ul class="blockList">
<li class="blockList"><a name="methods_inherited_from_class_java.lang.Object">
<!-- -->
</a>
<h3>Methods inherited from class java.lang.Object</h3>
<code>clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait</code></li>
</ul>
<ul class="blockList">
<li class="blockList"><a name="methods_inherited_from_class_org.apache.spark.Logging">
<!-- -->
</a>
<h3>Methods inherited from interface org.apache.spark.<a href="../../../../../org/apache/spark/Logging.html" title="interface in org.apache.spark">Logging</a></h3>
<code><a href="../../../../../org/apache/spark/Logging.html#initializeIfNecessary()">initializeIfNecessary</a>, <a href="../../../../../org/apache/spark/Logging.html#initializeLogging()">initializeLogging</a>, <a href="../../../../../org/apache/spark/Logging.html#isTraceEnabled()">isTraceEnabled</a>, <a href="../../../../../org/apache/spark/Logging.html#log_()">log_</a>, <a href="../../../../../org/apache/spark/Logging.html#log()">log</a>, <a href="../../../../../org/apache/spark/Logging.html#logDebug(scala.Function0)">logDebug</a>, <a href="../../../../../org/apache/spark/Logging.html#logDebug(scala.Function0, java.lang.Throwable)">logDebug</a>, <a href="../../../../../org/apache/spark/Logging.html#logError(scala.Function0)">logError</a>, <a href="../../../../../org/apache/spark/Logging.html#logError(scala.Function0, java.lang.Throwable)">logError</a>, <a href="../../../../../org/apache/spark/Logging.html#logInfo(scala.Function0)">logInfo</a>, <a href="../../../../../org/apache/spark/Logging.html#logInfo(scala.Function0, java.lang.Throwable)">logInfo</a>, <a href="../../../../../org/apache/spark/Logging.html#logName()">logName</a>, <a href="../../../../../org/apache/spark/Logging.html#logTrace(scala.Function0)">logTrace</a>, <a href="../../../../../org/apache/spark/Logging.html#logTrace(scala.Function0, java.lang.Throwable)">logTrace</a>, <a href="../../../../../org/apache/spark/Logging.html#logWarning(scala.Function0)">logWarning</a>, <a href="../../../../../org/apache/spark/Logging.html#logWarning(scala.Function0, java.lang.Throwable)">logWarning</a></code></li>
</ul>
</li>
</ul>
</li>
</ul>
</div>
<div class="details">
<ul class="blockList">
<li class="blockList">
<!-- ========= CONSTRUCTOR DETAIL ======== -->
<ul class="blockList">
<li class="blockList"><a name="constructor_detail">
<!-- -->
</a>
<h3>Constructor Detail</h3>
<a name="DStream(org.apache.spark.streaming.StreamingContext, scala.reflect.ClassTag)">
<!-- -->
</a>
<ul class="blockListLast">
<li class="blockList">
<h4>DStream</h4>
<pre>public DStream(<a href="../../../../../org/apache/spark/streaming/StreamingContext.html" title="class in org.apache.spark.streaming">StreamingContext</a> ssc,
scala.reflect.ClassTag<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> evidence$1)</pre>
</li>
</ul>
</li>
</ul>
<!-- ============ METHOD DETAIL ========== -->
<ul class="blockList">
<li class="blockList"><a name="method_detail">
<!-- -->
</a>
<h3>Method Detail</h3>
<a name="toPairDStreamFunctions(org.apache.spark.streaming.dstream.DStream, scala.reflect.ClassTag, scala.reflect.ClassTag, scala.math.Ordering)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>toPairDStreamFunctions</h4>
<pre>public static <K,V> <a href="../../../../../org/apache/spark/streaming/dstream/PairDStreamFunctions.html" title="class in org.apache.spark.streaming.dstream">PairDStreamFunctions</a><K,V> toPairDStreamFunctions(<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><scala.Tuple2<K,V>> stream,
scala.reflect.ClassTag<K> kt,
scala.reflect.ClassTag<V> vt,
scala.math.Ordering<K> ord)</pre>
</li>
</ul>
<a name="ssc()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>ssc</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/StreamingContext.html" title="class in org.apache.spark.streaming">StreamingContext</a> ssc()</pre>
</li>
</ul>
<a name="slideDuration()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>slideDuration</h4>
<pre>public abstract <a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> slideDuration()</pre>
<div class="block">Time interval after which the DStream generates a RDD</div>
</li>
</ul>
<a name="dependencies()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>dependencies</h4>
<pre>public abstract scala.collection.immutable.List<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><?>> dependencies()</pre>
<div class="block">List of parent DStreams on which this DStream depends on</div>
</li>
</ul>
<a name="compute(org.apache.spark.streaming.Time)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>compute</h4>
<pre>public abstract scala.Option<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>> compute(<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a> validTime)</pre>
<div class="block">Method that generates a RDD for the given time</div>
</li>
</ul>
<a name="generatedRDDs()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>generatedRDDs</h4>
<pre>public scala.collection.mutable.HashMap<<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>> generatedRDDs()</pre>
</li>
</ul>
<a name="zeroTime()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>zeroTime</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a> zeroTime()</pre>
</li>
</ul>
<a name="rememberDuration()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>rememberDuration</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> rememberDuration()</pre>
</li>
</ul>
<a name="storageLevel()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>storageLevel</h4>
<pre>public <a href="../../../../../org/apache/spark/storage/StorageLevel.html" title="class in org.apache.spark.storage">StorageLevel</a> storageLevel()</pre>
</li>
</ul>
<a name="mustCheckpoint()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>mustCheckpoint</h4>
<pre>public boolean mustCheckpoint()</pre>
</li>
</ul>
<a name="checkpointDuration()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>checkpointDuration</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> checkpointDuration()</pre>
</li>
</ul>
<a name="checkpointData()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>checkpointData</h4>
<pre>public org.apache.spark.streaming.dstream.DStreamCheckpointData<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> checkpointData()</pre>
</li>
</ul>
<a name="graph()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>graph</h4>
<pre>public org.apache.spark.streaming.DStreamGraph graph()</pre>
</li>
</ul>
<a name="context()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>context</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/StreamingContext.html" title="class in org.apache.spark.streaming">StreamingContext</a> context()</pre>
<div class="block">Return the StreamingContext associated with this DStream</div>
</li>
</ul>
<a name="creationSite()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>creationSite</h4>
<pre>public org.apache.spark.util.CallSite creationSite()</pre>
</li>
</ul>
<a name="baseScope()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>baseScope</h4>
<pre>protected scala.Option<java.lang.String> baseScope()</pre>
<div class="block">The base scope associated with the operation that created this DStream.
<p>
This is the medium through which we pass the DStream operation name (e.g. updatedStateByKey)
to the RDDs created by this DStream. Note that we never use this scope directly in RDDs.
Instead, we instantiate a new scope during each call to <code>compute</code> based on this one.
<p>
This is not defined if the DStream is created outside of one of the public DStream operations.</div>
<dl><dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="persist(org.apache.spark.storage.StorageLevel)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>persist</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> persist(<a href="../../../../../org/apache/spark/storage/StorageLevel.html" title="class in org.apache.spark.storage">StorageLevel</a> level)</pre>
<div class="block">Persist the RDDs of this DStream with the given storage level</div>
</li>
</ul>
<a name="persist()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>persist</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> persist()</pre>
<div class="block">Persist RDDs of this DStream with the default storage level (MEMORY_ONLY_SER)</div>
</li>
</ul>
<a name="cache()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>cache</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> cache()</pre>
<div class="block">Persist RDDs of this DStream with the default storage level (MEMORY_ONLY_SER)</div>
</li>
</ul>
<a name="checkpoint(org.apache.spark.streaming.Duration)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>checkpoint</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> checkpoint(<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> interval)</pre>
<div class="block">Enable periodic checkpointing of RDDs of this DStream</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>interval</code> - Time interval after which generated RDD will be checkpointed</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="createRDDWithLocalProperties(org.apache.spark.streaming.Time, scala.Function0)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>createRDDWithLocalProperties</h4>
<pre>protected <U> U createRDDWithLocalProperties(<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a> time,
scala.Function0<U> body)</pre>
<div class="block">Wrap a body of code such that the call site and operation scope
information are passed to the RDDs created in this body properly.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>time</code> - (undocumented)</dd><dd><code>body</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="map(scala.Function1, scala.reflect.ClassTag)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>map</h4>
<pre>public <U> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U> map(scala.Function1<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,U> mapFunc,
scala.reflect.ClassTag<U> evidence$2)</pre>
<div class="block">Return a new DStream by applying a function to all elements of this DStream.</div>
</li>
</ul>
<a name="flatMap(scala.Function1, scala.reflect.ClassTag)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>flatMap</h4>
<pre>public <U> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U> flatMap(scala.Function1<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,scala.collection.Traversable<U>> flatMapFunc,
scala.reflect.ClassTag<U> evidence$3)</pre>
<div class="block">Return a new DStream by applying a function to all elements of this DStream,
and then flattening the results</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>flatMapFunc</code> - (undocumented)</dd><dd><code>evidence$3</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="filter(scala.Function1)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>filter</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> filter(scala.Function1<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,java.lang.Object> filterFunc)</pre>
<div class="block">Return a new DStream containing only the elements that satisfy a predicate.</div>
</li>
</ul>
<a name="glom()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>glom</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><java.lang.Object> glom()</pre>
<div class="block">Return a new DStream in which each RDD is generated by applying glom() to each RDD of
this DStream. Applying glom() to an RDD coalesces all elements within each partition into
an array.</div>
<dl><dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="repartition(int)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>repartition</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> repartition(int numPartitions)</pre>
<div class="block">Return a new DStream with an increased or decreased level of parallelism. Each RDD in the
returned DStream has exactly numPartitions partitions.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>numPartitions</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="mapPartitions(scala.Function1, boolean, scala.reflect.ClassTag)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>mapPartitions</h4>
<pre>public <U> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U> mapPartitions(scala.Function1<scala.collection.Iterator<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,scala.collection.Iterator<U>> mapPartFunc,
boolean preservePartitioning,
scala.reflect.ClassTag<U> evidence$4)</pre>
<div class="block">Return a new DStream in which each RDD is generated by applying mapPartitions() to each RDDs
of this DStream. Applying mapPartitions() to an RDD applies a function to each partition
of the RDD.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>mapPartFunc</code> - (undocumented)</dd><dd><code>preservePartitioning</code> - (undocumented)</dd><dd><code>evidence$4</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="reduce(scala.Function2)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>reduce</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> reduce(scala.Function2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> reduceFunc)</pre>
<div class="block">Return a new DStream in which each RDD has a single element generated by reducing each RDD
of this DStream.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>reduceFunc</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="count()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>count</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><java.lang.Object> count()</pre>
<div class="block">Return a new DStream in which each RDD has a single element generated by counting each RDD
of this DStream.</div>
<dl><dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="countByValue(int, scala.math.Ordering)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>countByValue</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><scala.Tuple2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,java.lang.Object>> countByValue(int numPartitions,
scala.math.Ordering<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> ord)</pre>
<div class="block">Return a new DStream in which each RDD contains the counts of each distinct value in
each RDD of this DStream. Hash partitioning is used to generate
the RDDs with <code>numPartitions</code> partitions (Spark's default number of partitions if
<code>numPartitions</code> not specified).</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>numPartitions</code> - (undocumented)</dd><dd><code>ord</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="foreach(scala.Function1)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>foreach</h4>
<pre>public void foreach(scala.Function1<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,scala.runtime.BoxedUnit> foreachFunc)</pre>
<div class="block"><span class="strong">Deprecated.</span> <i>As of 0.9.0, replaced by <code>foreachRDD</code>.</i></div>
<div class="block">Apply a function to each RDD in this DStream. This is an output operator, so
'this' DStream will be registered as an output stream and therefore materialized.
<p></div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>foreachFunc</code> - (undocumented)</dd></dl>
</li>
</ul>
<a name="foreach(scala.Function2)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>foreach</h4>
<pre>public void foreach(scala.Function2<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a>,scala.runtime.BoxedUnit> foreachFunc)</pre>
<div class="block"><span class="strong">Deprecated.</span> <i>As of 0.9.0, replaced by <code>foreachRDD</code>.</i></div>
<div class="block">Apply a function to each RDD in this DStream. This is an output operator, so
'this' DStream will be registered as an output stream and therefore materialized.
<p></div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>foreachFunc</code> - (undocumented)</dd></dl>
</li>
</ul>
<a name="foreachRDD(scala.Function1)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>foreachRDD</h4>
<pre>public void foreachRDD(scala.Function1<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,scala.runtime.BoxedUnit> foreachFunc)</pre>
<div class="block">Apply a function to each RDD in this DStream. This is an output operator, so
'this' DStream will be registered as an output stream and therefore materialized.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>foreachFunc</code> - (undocumented)</dd></dl>
</li>
</ul>
<a name="foreachRDD(scala.Function2)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>foreachRDD</h4>
<pre>public void foreachRDD(scala.Function2<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a>,scala.runtime.BoxedUnit> foreachFunc)</pre>
<div class="block">Apply a function to each RDD in this DStream. This is an output operator, so
'this' DStream will be registered as an output stream and therefore materialized.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>foreachFunc</code> - (undocumented)</dd></dl>
</li>
</ul>
<a name="transform(scala.Function1, scala.reflect.ClassTag)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>transform</h4>
<pre>public <U> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U> transform(scala.Function1<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><U>> transformFunc,
scala.reflect.ClassTag<U> evidence$5)</pre>
<div class="block">Return a new DStream in which each RDD is generated by applying a function
on each RDD of 'this' DStream.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>transformFunc</code> - (undocumented)</dd><dd><code>evidence$5</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="transform(scala.Function2, scala.reflect.ClassTag)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>transform</h4>
<pre>public <U> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U> transform(scala.Function2<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><U>> transformFunc,
scala.reflect.ClassTag<U> evidence$6)</pre>
<div class="block">Return a new DStream in which each RDD is generated by applying a function
on each RDD of 'this' DStream.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>transformFunc</code> - (undocumented)</dd><dd><code>evidence$6</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="transformWith(org.apache.spark.streaming.dstream.DStream, scala.Function2, scala.reflect.ClassTag, scala.reflect.ClassTag)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>transformWith</h4>
<pre>public <U,V> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><V> transformWith(<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U> other,
scala.Function2<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><U>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><V>> transformFunc,
scala.reflect.ClassTag<U> evidence$7,
scala.reflect.ClassTag<V> evidence$8)</pre>
<div class="block">Return a new DStream in which each RDD is generated by applying a function
on each RDD of 'this' DStream and 'other' DStream.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>other</code> - (undocumented)</dd><dd><code>transformFunc</code> - (undocumented)</dd><dd><code>evidence$7</code> - (undocumented)</dd><dd><code>evidence$8</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="transformWith(org.apache.spark.streaming.dstream.DStream, scala.Function3, scala.reflect.ClassTag, scala.reflect.ClassTag)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>transformWith</h4>
<pre>public <U,V> <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><V> transformWith(<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><U> other,
scala.Function3<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><U>,<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a>,<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><V>> transformFunc,
scala.reflect.ClassTag<U> evidence$9,
scala.reflect.ClassTag<V> evidence$10)</pre>
<div class="block">Return a new DStream in which each RDD is generated by applying a function
on each RDD of 'this' DStream and 'other' DStream.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>other</code> - (undocumented)</dd><dd><code>transformFunc</code> - (undocumented)</dd><dd><code>evidence$9</code> - (undocumented)</dd><dd><code>evidence$10</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="print()">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>print</h4>
<pre>public void print()</pre>
<div class="block">Print the first ten elements of each RDD generated in this DStream. This is an output
operator, so this DStream will be registered as an output stream and there materialized.</div>
</li>
</ul>
<a name="print(int)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>print</h4>
<pre>public void print(int num)</pre>
<div class="block">Print the first num elements of each RDD generated in this DStream. This is an output
operator, so this DStream will be registered as an output stream and there materialized.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>num</code> - (undocumented)</dd></dl>
</li>
</ul>
<a name="window(org.apache.spark.streaming.Duration)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>window</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> window(<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration)</pre>
<div class="block">Return a new DStream in which each RDD contains all the elements in seen in a
sliding window of time over this DStream. The new DStream generates RDDs with
the same interval as this DStream.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>windowDuration</code> - width of the window; must be a multiple of this DStream's interval.</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="window(org.apache.spark.streaming.Duration, org.apache.spark.streaming.Duration)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>window</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> window(<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> slideDuration)</pre>
<div class="block">Return a new DStream in which each RDD contains all the elements in seen in a
sliding window of time over this DStream.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>windowDuration</code> - width of the window; must be a multiple of this DStream's
batching interval</dd><dd><code>slideDuration</code> - sliding interval of the window (i.e., the interval after which
the new DStream will generate RDDs); must be a multiple of this
DStream's batching interval</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="reduceByWindow(scala.Function2, org.apache.spark.streaming.Duration, org.apache.spark.streaming.Duration)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>reduceByWindow</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> reduceByWindow(scala.Function2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> reduceFunc,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> slideDuration)</pre>
<div class="block">Return a new DStream in which each RDD has a single element generated by reducing all
elements in a sliding window over this DStream.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>reduceFunc</code> - associative reduce function</dd><dd><code>windowDuration</code> - width of the window; must be a multiple of this DStream's
batching interval</dd><dd><code>slideDuration</code> - sliding interval of the window (i.e., the interval after which
the new DStream will generate RDDs); must be a multiple of this
DStream's batching interval</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="reduceByWindow(scala.Function2, scala.Function2, org.apache.spark.streaming.Duration, org.apache.spark.streaming.Duration)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>reduceByWindow</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> reduceByWindow(scala.Function2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> reduceFunc,
scala.Function2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> invReduceFunc,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> slideDuration)</pre>
<div class="block">Return a new DStream in which each RDD has a single element generated by reducing all
elements in a sliding window over this DStream. However, the reduction is done incrementally
using the old window's reduced value :
1. reduce the new values that entered the window (e.g., adding new counts)
2. "inverse reduce" the old values that left the window (e.g., subtracting old counts)
This is more efficient than reduceByWindow without "inverse reduce" function.
However, it is applicable to only "invertible reduce functions".</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>reduceFunc</code> - associative reduce function</dd><dd><code>invReduceFunc</code> - inverse reduce function</dd><dd><code>windowDuration</code> - width of the window; must be a multiple of this DStream's
batching interval</dd><dd><code>slideDuration</code> - sliding interval of the window (i.e., the interval after which
the new DStream will generate RDDs); must be a multiple of this
DStream's batching interval</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="countByWindow(org.apache.spark.streaming.Duration, org.apache.spark.streaming.Duration)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>countByWindow</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><java.lang.Object> countByWindow(<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> slideDuration)</pre>
<div class="block">Return a new DStream in which each RDD has a single element generated by counting the number
of elements in a sliding window over this DStream. Hash partitioning is used to generate
the RDDs with Spark's default number of partitions.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>windowDuration</code> - width of the window; must be a multiple of this DStream's
batching interval</dd><dd><code>slideDuration</code> - sliding interval of the window (i.e., the interval after which
the new DStream will generate RDDs); must be a multiple of this
DStream's batching interval</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="countByValueAndWindow(org.apache.spark.streaming.Duration, org.apache.spark.streaming.Duration, int, scala.math.Ordering)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>countByValueAndWindow</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><scala.Tuple2<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>,java.lang.Object>> countByValueAndWindow(<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> windowDuration,
<a href="../../../../../org/apache/spark/streaming/Duration.html" title="class in org.apache.spark.streaming">Duration</a> slideDuration,
int numPartitions,
scala.math.Ordering<<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> ord)</pre>
<div class="block">Return a new DStream in which each RDD contains the count of distinct elements in
RDDs in a sliding window over this DStream. Hash partitioning is used to generate
the RDDs with <code>numPartitions</code> partitions (Spark's default number of partitions if
<code>numPartitions</code> not specified).</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>windowDuration</code> - width of the window; must be a multiple of this DStream's
batching interval</dd><dd><code>slideDuration</code> - sliding interval of the window (i.e., the interval after which
the new DStream will generate RDDs); must be a multiple of this
DStream's batching interval</dd><dd><code>numPartitions</code> - number of partitions of each RDD in the new DStream.</dd><dd><code>ord</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="union(org.apache.spark.streaming.dstream.DStream)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>union</h4>
<pre>public <a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> union(<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="class in org.apache.spark.streaming.dstream">DStream</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>> that)</pre>
<div class="block">Return a new DStream by unifying data of another DStream with this DStream.</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>that</code> - Another DStream having the same slideDuration as this DStream.</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="slice(org.apache.spark.streaming.Interval)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>slice</h4>
<pre>public scala.collection.Seq<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>> slice(org.apache.spark.streaming.Interval interval)</pre>
<div class="block">Return all the RDDs defined by the Interval object (both end times included)</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>interval</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="slice(org.apache.spark.streaming.Time, org.apache.spark.streaming.Time)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>slice</h4>
<pre>public scala.collection.Seq<<a href="../../../../../org/apache/spark/rdd/RDD.html" title="class in org.apache.spark.rdd">RDD</a><<a href="../../../../../org/apache/spark/streaming/dstream/DStream.html" title="type parameter in DStream">T</a>>> slice(<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a> fromTime,
<a href="../../../../../org/apache/spark/streaming/Time.html" title="class in org.apache.spark.streaming">Time</a> toTime)</pre>
<div class="block">Return all the RDDs between 'fromTime' to 'toTime' (both included)</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>fromTime</code> - (undocumented)</dd><dd><code>toTime</code> - (undocumented)</dd>
<dt><span class="strong">Returns:</span></dt><dd>(undocumented)</dd></dl>
</li>
</ul>
<a name="saveAsObjectFiles(java.lang.String, java.lang.String)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>saveAsObjectFiles</h4>
<pre>public void saveAsObjectFiles(java.lang.String prefix,
java.lang.String suffix)</pre>
<div class="block">Save each RDD in this DStream as a Sequence file of serialized objects.
The file name at each batch interval is generated based on <code>prefix</code> and
<code>suffix</code>: "prefix-TIME_IN_MS.suffix".</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>prefix</code> - (undocumented)</dd><dd><code>suffix</code> - (undocumented)</dd></dl>
</li>
</ul>
<a name="saveAsTextFiles(java.lang.String, java.lang.String)">
<!-- -->
</a>
<ul class="blockListLast">
<li class="blockList">
<h4>saveAsTextFiles</h4>
<pre>public void saveAsTextFiles(java.lang.String prefix,
java.lang.String suffix)</pre>
<div class="block">Save each RDD in this DStream as at text file, using string representation
of elements. The file name at each batch interval is generated based on
<code>prefix</code> and <code>suffix</code>: "prefix-TIME_IN_MS.suffix".</div>
<dl><dt><span class="strong">Parameters:</span></dt><dd><code>prefix</code> - (undocumented)</dd><dd><code>suffix</code> - (undocumented)</dd></dl>
</li>
</ul>
</li>
</ul>
</li>
</ul>
</div>
</div>
<!-- ========= END OF CLASS DATA ========= -->
<!-- ======= START OF BOTTOM NAVBAR ====== -->
<div class="bottomNav"><a name="navbar_bottom">
<!-- -->
</a><a href="#skip-navbar_bottom" title="Skip navigation links"></a><a name="navbar_bottom_firstrow">
<!-- -->
</a>
<ul class="navList" title="Navigation">
<li><a href="../../../../../overview-summary.html">Overview</a></li>
<li><a href="package-summary.html">Package</a></li>
<li class="navBarCell1Rev">Class</li>
<li><a href="package-tree.html">Tree</a></li>
<li><a href="../../../../../deprecated-list.html">Deprecated</a></li>
<li><a href="../../../../../index-all.html">Index</a></li>
<li><a href="../../../../../help-doc.html">Help</a></li>
</ul>
</div>
<div class="subNav">
<ul class="navList">
<li><a href="../../../../../org/apache/spark/streaming/dstream/ConstantInputDStream.html" title="class in org.apache.spark.streaming.dstream"><span class="strong">Prev Class</span></a></li>
<li><a href="../../../../../org/apache/spark/streaming/dstream/InputDStream.html" title="class in org.apache.spark.streaming.dstream"><span class="strong">Next Class</span></a></li>
</ul>
<ul class="navList">
<li><a href="../../../../../index.html?org/apache/spark/streaming/dstream/DStream.html" target="_top">Frames</a></li>
<li><a href="DStream.html" target="_top">No Frames</a></li>
</ul>
<ul class="navList" id="allclasses_navbar_bottom">
<li><a href="../../../../../allclasses-noframe.html">All Classes</a></li>
</ul>
<div>
<script type="text/javascript"><!--
allClassesLink = document.getElementById("allclasses_navbar_bottom");
if(window==top) {
allClassesLink.style.display = "block";
}
else {
allClassesLink.style.display = "none";
}
//-->
</script>
</div>
<div>
<ul class="subNavList">
<li>Summary: </li>
<li>Nested | </li>
<li>Field | </li>
<li><a href="#constructor_summary">Constr</a> | </li>
<li><a href="#method_summary">Method</a></li>
</ul>
<ul class="subNavList">
<li>Detail: </li>
<li>Field | </li>
<li><a href="#constructor_detail">Constr</a> | </li>
<li><a href="#method_detail">Method</a></li>
</ul>
</div>
<a name="skip-navbar_bottom">
<!-- -->
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
<script defer="defer" type="text/javascript" src="../../../../../lib/jquery.js"></script><script defer="defer" type="text/javascript" src="../../../../../lib/api-javadocs.js"></script></body>
</html>